Commit Graph

204 Commits

Author SHA1 Message Date
3702249b1a fix a bunch of snapshot tests 2022-10-20 16:37:29 +02:00
188e95d00f Delete the tasks content file once the transaction has been successfully committed 2022-10-20 16:37:28 +02:00
ad05bd9156 Remove the useless r#union thing 2022-10-20 16:37:28 +02:00
ea0dcf2c7c Clean up the delete_persisted_task_data function 2022-10-20 16:37:28 +02:00
0bbda61169 Throw the error if we can't register the tasks in the store 2022-10-20 16:37:28 +02:00
9945f984db Introduce a ProcessingTasks constructor 2022-10-20 16:37:27 +02:00
fd73306793 Extract the must_stop flag out of the RwLock 2022-10-20 16:37:27 +02:00
07db4cfab0 Prefer using an u64 instead of a usize in some places 2022-10-20 16:37:27 +02:00
cc6e2fd1e8 Delete the persisted data when we cancel a task 2022-10-20 16:37:27 +02:00
afafe8d207 Put the original URL query in the tasks details 2022-10-20 16:37:26 +02:00
973e2f71eb Add the tasks cancel route to cancel tasks 2022-10-20 16:37:26 +02:00
01ed1fb128 Update the canceledBy and finishedAt fields 2022-10-20 16:37:26 +02:00
74657bba2c Introduce the core algorithm of task cancelation 2022-10-20 16:37:26 +02:00
6276b2a382 Add more enum-iterator related stuff 2022-10-20 16:37:26 +02:00
607a0600e5 Prefer using TaskDeletion in the dumps 2022-10-20 16:35:06 +02:00
bcb7d1744a Introduce the task cancelation task type 2022-10-20 16:35:06 +02:00
b8803781dc Introduce the ProcessingTasks struct 2022-10-20 16:35:05 +02:00
baeb168b6e Delete a task's persisted data when appropriate 2022-10-20 16:34:32 +02:00
99f1d5df20 fix the tests 2022-10-20 16:14:37 +02:00
0bde0abd74 share the rtxn between the access to the tasks and to the indexes 2022-10-20 16:14:37 +02:00
dbcc3456c6 dump the content of the dump tasks instead of recreating at import time with wrong API keys 2022-10-20 16:14:36 +02:00
09a0569228 remove useless todo 2022-10-20 16:14:36 +02:00
8e469d8d1d flush the dump-writer only once everything has been inserted 2022-10-20 16:14:36 +02:00
b87b071718 apply most style comments of the review 2022-10-20 16:14:36 +02:00
458a531547 rebase on index-scheduler 2022-10-20 16:14:35 +02:00
6987bc185e fix a synchronization bug while importing tasks 2022-10-20 16:13:18 +02:00
748249578d commit after creating an index 2022-10-20 16:13:17 +02:00
9b96085327 the index-scheduler needs to wake-up after importing a dump 2022-10-20 16:13:17 +02:00
c82bd429db fix the content_file import 2022-10-20 16:13:17 +02:00
8c9b758fa8 stop dumping the current dumping task as enqueued so it's not looping for ever 2022-10-20 16:13:17 +02:00
cac924b663 first mostly working version 2022-10-20 16:13:16 +02:00
6fae317277 update the API a little bit 2022-10-20 16:12:26 +02:00
1a3fea4d8c fix the tests 2022-10-20 16:12:26 +02:00
9323f9f1c4 write the dump export 2022-10-20 16:12:25 +02:00
7ce336306d Fix number of deleted tasks details after duplicate task deletion 2022-10-20 16:09:33 +02:00
d49d7e9c2d Add task deletion tests where the same task is deleted twice 2022-10-20 16:09:33 +02:00
dabc30d3d6 Return an error when calling DELETE /tasks with an empty query 2022-10-20 16:09:32 +02:00
9067148270 Apply suggested changes from PR review 2022-10-20 16:09:32 +02:00
4bd8607cf9 Avoid creating two read txn at the same time 2022-10-20 16:09:32 +02:00
4c6145f782 Update snapshot tests following git rebase that fixes a bug 2022-10-20 16:09:32 +02:00
012c3e986c Finish first draft of the DELETE /tasks route 2022-10-20 16:09:32 +02:00
ef3e9e87f5 Continue implementation of task deletion
1. Matched tasks are a roaring bitmap
2. Start implementation in meilisearch-http
3. Snapshots use meili-snap
4. Rename to TaskDeletion
2022-10-20 16:08:16 +02:00
7d4527728e Make sure that we do not batch tasks from different indexes 2022-10-20 16:00:58 +02:00
1c697edb95 Add a test to check different indexes autobatching 2022-10-20 16:00:58 +02:00
8433a432b1 Extract index creation rights and simplify the autobatcher rules 2022-10-20 16:00:58 +02:00
ea192d31f4 Fix invalid import of tasks types 2022-10-20 16:00:58 +02:00
dc1d739785 move the API key in meilisearch_types 2022-10-20 16:00:58 +02:00
c9050759f5 remove an unused file 2022-10-20 15:59:53 +02:00
e533e740d4 refactor the Task a little bit 2022-10-20 15:59:52 +02:00
e6c033bd6b start moving a lot of task types to meilisearch_types 2022-10-20 15:59:52 +02:00