Commit Graph

296 Commits

Author SHA1 Message Date
Irevoire
1d04ce611d remove ununsed function 2022-10-27 11:35:08 +02:00
Irevoire
e9055f5572 fix clippy 2022-10-27 11:35:08 +02:00
Irevoire
8d1408c65e fix the import of the dumpv4&v5 when there is no instance-uid + rename the Kind+KindWithContent+Details variant for the DocumentImport and the Setting 2022-10-27 11:35:05 +02:00
Clément Renault
80b2e70ee7 Introduce a rustfmt file 2022-10-27 11:35:05 +02:00
Irevoire
b6a0abea9f fix the index deletion when the index doesn’t exists but would be created by one of the autobatched tasks 2022-10-27 11:34:16 +02:00
Loïc Lecrenier
11fee30f47 Apply review suggestions and stop using rtxn.commit 2022-10-27 11:34:15 +02:00
Loïc Lecrenier
17cd2a4aa0 Implement POST /indexes-swap 2022-10-27 11:34:15 +02:00
Loïc Lecrenier
169f386418 Add some documentation to the index scheduler 2022-10-27 11:34:15 +02:00
Loïc Lecrenier
ec3391808d Fix date parsing for task queries
Use rfc3339 or YYYY-MM-DD.

Add a day to the parsed date when it is an excluded lower bound
and the YYYY-MM-DD was used.

Also the Query type does not need to be serialisable anymore
2022-10-27 11:34:14 +02:00
Loïc Lecrenier
22cf0559fe Implement task date filters
before/after enqueued/started/finished at
2022-10-27 11:34:14 +02:00
Irevoire
5765883600 fix the auto-generated details 2022-10-27 11:34:14 +02:00
Kerollmops
6460b78e08 Clean up the delete_persisted_task_data function 2022-10-27 11:34:13 +02:00
Kerollmops
d21651c968 Throw the error if we can't register the tasks in the store 2022-10-27 11:34:13 +02:00
Kerollmops
6e904d0997 Introduce a ProcessingTasks constructor 2022-10-27 11:34:12 +02:00
Kerollmops
b373d19831 Extract the must_stop flag out of the RwLock 2022-10-27 11:34:12 +02:00
Kerollmops
751e9bac3b Add the tasks cancel route to cancel tasks 2022-10-27 11:34:11 +02:00
Kerollmops
290945e258 Update the canceledBy and finishedAt fields 2022-10-27 11:34:11 +02:00
Kerollmops
b2c5bc67b7 Add more enum-iterator related stuff 2022-10-27 11:34:11 +02:00
Kerollmops
591527a99d Prefer using TaskDeletion in the dumps 2022-10-27 11:34:11 +02:00
Kerollmops
1ca9a67c49 Introduce the task cancelation task type 2022-10-27 11:34:11 +02:00
Kerollmops
703ba7a1fb Introduce the ProcessingTasks struct 2022-10-27 11:34:10 +02:00
Loïc Lecrenier
ea60d35c71 Delete a task's persisted data when appropriate 2022-10-27 11:34:10 +02:00
Tamo
9e85f050b2 fix the tests 2022-10-27 11:34:09 +02:00
Tamo
6bd6321226 dump the content of the dump tasks instead of recreating at import time with wrong API keys 2022-10-27 11:34:08 +02:00
Tamo
655705eb2b remove useless todo 2022-10-27 11:34:08 +02:00
Tamo
78ce29f461 apply most style comments of the review 2022-10-27 11:34:08 +02:00
Tamo
d0e91555d1 rebase on index-scheduler 2022-10-27 11:34:08 +02:00
Tamo
e0221fc0a3 fix a synchronization bug while importing tasks 2022-10-27 11:34:07 +02:00
Tamo
ba150f2127 commit after creating an index 2022-10-27 11:34:07 +02:00
Tamo
e9295c03ce the index-scheduler needs to wake-up after importing a dump 2022-10-27 11:34:06 +02:00
Tamo
d481669b7e fix the content_file import 2022-10-27 11:34:06 +02:00
Tamo
d976e680c5 first mostly working version 2022-10-27 11:34:06 +02:00
Tamo
c051166bcc update the API a little bit 2022-10-27 11:34:05 +02:00
Tamo
b7f9c94f4a write the dump export 2022-10-27 11:34:05 +02:00
Loïc Lecrenier
8954b1bd1d Fix number of deleted tasks details after duplicate task deletion 2022-10-27 11:34:05 +02:00
Loïc Lecrenier
8defad6c38 Add task deletion tests where the same task is deleted twice 2022-10-27 11:34:05 +02:00
Loïc Lecrenier
f32b973945 Return an error when calling DELETE /tasks with an empty query 2022-10-27 11:34:04 +02:00
Loïc Lecrenier
441417447e Avoid creating two read txn at the same time 2022-10-27 11:34:04 +02:00
Loïc Lecrenier
8c6aeaada5 Update snapshot tests following git rebase that fixes a bug 2022-10-27 11:34:04 +02:00
Loïc Lecrenier
8bb0fcd144 Finish first draft of the DELETE /tasks route 2022-10-27 11:34:04 +02:00
Loïc Lecrenier
9522b75454 Continue implementation of task deletion
1. Matched tasks are a roaring bitmap
2. Start implementation in meilisearch-http
3. Snapshots use meili-snap
4. Rename to TaskDeletion
2022-10-27 11:34:03 +02:00
Kerollmops
e4d461ecba Make sure that we do not batch tasks from different indexes 2022-10-27 11:34:03 +02:00
Kerollmops
b029369653 Add a test to check different indexes autobatching 2022-10-27 11:34:03 +02:00
Tamo
c192146fbe remove an unused file 2022-10-27 11:34:02 +02:00
Tamo
2f1eb78b1d refactor the Task a little bit 2022-10-27 11:34:02 +02:00
Tamo
510ce9fc51 start moving a lot of task types to meilisearch_types 2022-10-27 11:34:01 +02:00
Tamo
667c282e19 get rids of the index crate + the document_types crate 2022-10-27 11:34:00 +02:00
Loïc Lecrenier
9a74ea0943 Fix compiler errors related autobatching option of the index scheduler 2022-10-27 11:34:00 +02:00
Loïc Lecrenier
eabac9676b Fix typo and remove useless code in tests 2022-10-27 11:34:00 +02:00
Loïc Lecrenier
568199fc0d Add more task deletion tests 2022-10-27 11:33:59 +02:00