Commit Graph

4252 Commits

Author SHA1 Message Date
4f1c0535b4 Use a tokio block_in_place method for potentially blocking tasks 2022-10-20 16:37:27 +02:00
afafe8d207 Put the original URL query in the tasks details 2022-10-20 16:37:26 +02:00
973e2f71eb Add the tasks cancel route to cancel tasks 2022-10-20 16:37:26 +02:00
01ed1fb128 Update the canceledBy and finishedAt fields 2022-10-20 16:37:26 +02:00
74657bba2c Introduce the core algorithm of task cancelation 2022-10-20 16:37:26 +02:00
6276b2a382 Add more enum-iterator related stuff 2022-10-20 16:37:26 +02:00
607a0600e5 Prefer using TaskDeletion in the dumps 2022-10-20 16:35:06 +02:00
bcb7d1744a Introduce the task cancelation task type 2022-10-20 16:35:06 +02:00
4a7b5c7836 Add the canceled task status 2022-10-20 16:35:05 +02:00
b8803781dc Introduce the ProcessingTasks struct 2022-10-20 16:35:05 +02:00
47168c613d Use the indexation-abortion milli's branch 2022-10-20 16:35:05 +02:00
e7047e8377 Remove the meilisearch-auth milli dependency 2022-10-20 16:34:33 +02:00
baeb168b6e Delete a task's persisted data when appropriate 2022-10-20 16:34:32 +02:00
7308ccd530 make the tests compile again 2022-10-20 16:34:32 +02:00
656f809b1d fix the analytics 2022-10-20 16:26:17 +02:00
65e69c06bc extract the create_app function for the tests 2022-10-20 16:26:17 +02:00
aff67f78c1 bump enum-iter and fix a bunch of error messages 2022-10-20 16:24:23 +02:00
4921e926e5 fix meilisearch-http 2022-10-20 16:14:37 +02:00
99f1d5df20 fix the tests 2022-10-20 16:14:37 +02:00
0bde0abd74 share the rtxn between the access to the tasks and to the indexes 2022-10-20 16:14:37 +02:00
dbcc3456c6 dump the content of the dump tasks instead of recreating at import time with wrong API keys 2022-10-20 16:14:36 +02:00
09a0569228 remove useless todo 2022-10-20 16:14:36 +02:00
860d343831 get rids of the useless Seek before creating a grenad reader 2022-10-20 16:14:36 +02:00
8e469d8d1d flush the dump-writer only once everything has been inserted 2022-10-20 16:14:36 +02:00
b87b071718 apply most style comments of the review 2022-10-20 16:14:36 +02:00
e220cc2183 Update dump/src/error.rs
Co-authored-by: Clément Renault <clement@meilisearch.com>
2022-10-20 16:14:36 +02:00
458a531547 rebase on index-scheduler 2022-10-20 16:14:35 +02:00
6987bc185e fix a synchronization bug while importing tasks 2022-10-20 16:13:18 +02:00
a2384dc627 fix all the errors code and settings issues when importing a dump v2 2022-10-20 16:13:18 +02:00
bab0e050f1 fix all the error codes 2022-10-20 16:13:18 +02:00
748249578d commit after creating an index 2022-10-20 16:13:17 +02:00
54d4d364c2 fix the deletion of the data.ms in case of errors 2022-10-20 16:13:17 +02:00
9b96085327 the index-scheduler needs to wake-up after importing a dump 2022-10-20 16:13:17 +02:00
4c1c108a19 remove the dbg 2022-10-20 16:13:17 +02:00
c82bd429db fix the content_file import 2022-10-20 16:13:17 +02:00
8c9b758fa8 stop dumping the current dumping task as enqueued so it's not looping for ever 2022-10-20 16:13:17 +02:00
ede46b716c add a bufwriter on the documents 2022-10-20 16:13:16 +02:00
cac924b663 first mostly working version 2022-10-20 16:13:16 +02:00
6fae317277 update the API a little bit 2022-10-20 16:12:26 +02:00
1a3fea4d8c fix the tests 2022-10-20 16:12:26 +02:00
9323f9f1c4 write the dump export 2022-10-20 16:12:25 +02:00
7ce336306d Fix number of deleted tasks details after duplicate task deletion 2022-10-20 16:09:33 +02:00
d49d7e9c2d Add task deletion tests where the same task is deleted twice 2022-10-20 16:09:33 +02:00
dabc30d3d6 Return an error when calling DELETE /tasks with an empty query 2022-10-20 16:09:32 +02:00
9067148270 Apply suggested changes from PR review 2022-10-20 16:09:32 +02:00
4bd8607cf9 Avoid creating two read txn at the same time 2022-10-20 16:09:32 +02:00
4c6145f782 Update snapshot tests following git rebase that fixes a bug 2022-10-20 16:09:32 +02:00
012c3e986c Finish first draft of the DELETE /tasks route 2022-10-20 16:09:32 +02:00
ef3e9e87f5 Continue implementation of task deletion
1. Matched tasks are a roaring bitmap
2. Start implementation in meilisearch-http
3. Snapshots use meili-snap
4. Rename to TaskDeletion
2022-10-20 16:08:16 +02:00
7d4527728e Make sure that we do not batch tasks from different indexes 2022-10-20 16:00:58 +02:00