Commit Graph

69 Commits

Author SHA1 Message Date
afafe8d207 Put the original URL query in the tasks details 2022-10-20 16:37:26 +02:00
01ed1fb128 Update the canceledBy and finishedAt fields 2022-10-20 16:37:26 +02:00
74657bba2c Introduce the core algorithm of task cancelation 2022-10-20 16:37:26 +02:00
bcb7d1744a Introduce the task cancelation task type 2022-10-20 16:35:06 +02:00
b8803781dc Introduce the ProcessingTasks struct 2022-10-20 16:35:05 +02:00
baeb168b6e Delete a task's persisted data when appropriate 2022-10-20 16:34:32 +02:00
0bde0abd74 share the rtxn between the access to the tasks and to the indexes 2022-10-20 16:14:37 +02:00
8e469d8d1d flush the dump-writer only once everything has been inserted 2022-10-20 16:14:36 +02:00
b87b071718 apply most style comments of the review 2022-10-20 16:14:36 +02:00
8c9b758fa8 stop dumping the current dumping task as enqueued so it's not looping for ever 2022-10-20 16:13:17 +02:00
cac924b663 first mostly working version 2022-10-20 16:13:16 +02:00
6fae317277 update the API a little bit 2022-10-20 16:12:26 +02:00
1a3fea4d8c fix the tests 2022-10-20 16:12:26 +02:00
9323f9f1c4 write the dump export 2022-10-20 16:12:25 +02:00
7ce336306d Fix number of deleted tasks details after duplicate task deletion 2022-10-20 16:09:33 +02:00
d49d7e9c2d Add task deletion tests where the same task is deleted twice 2022-10-20 16:09:33 +02:00
9067148270 Apply suggested changes from PR review 2022-10-20 16:09:32 +02:00
012c3e986c Finish first draft of the DELETE /tasks route 2022-10-20 16:09:32 +02:00
ef3e9e87f5 Continue implementation of task deletion
1. Matched tasks are a roaring bitmap
2. Start implementation in meilisearch-http
3. Snapshots use meili-snap
4. Rename to TaskDeletion
2022-10-20 16:08:16 +02:00
7d4527728e Make sure that we do not batch tasks from different indexes 2022-10-20 16:00:58 +02:00
e533e740d4 refactor the Task a little bit 2022-10-20 15:59:52 +02:00
e6c033bd6b start moving a lot of task types to meilisearch_types 2022-10-20 15:59:52 +02:00
f456fb5e0b get rids of the index crate + the document_types crate 2022-10-20 15:57:52 +02:00
5914889a29 Apply suggestions from code review
Co-authored-by: Tamo <tamo@meilisearch.com>
2022-10-20 15:45:57 +02:00
fd73e65165 Add a DetailsView type and improve index scheduler snapshots
The DetailsView type is necessary because serde incorrectly
deserialises the `Details` type, so the database fails to correctly
decode Tasks
2022-10-20 15:45:57 +02:00
05753c663f Implement TaskDeletion in the index scheduler 2022-10-20 15:44:58 +02:00
ee352b6c7c Allow a user to disable the auto batching system 2022-10-20 15:44:58 +02:00
a358eaa816 Create the index only if the task has the rights to do so 2022-10-20 15:44:35 +02:00
134634d99a Correctly batch tasks with different index creation rights 2022-10-20 15:44:35 +02:00
be192f281d Only mark the first clear document with the amount of cleared documents 2022-10-20 15:44:34 +02:00
99d1e9a870 Let the tick function set the Failed status itself 2022-10-20 15:44:34 +02:00
945cb00fc3 Fill an IndexDeletion task with the number of documents removed 2022-10-20 15:44:34 +02:00
b7ad050737 Panic if we encountered a wring KindWithContent type 2022-10-20 15:44:34 +02:00
f3f6bbf624 Update the tasks statuses 2022-10-20 15:44:33 +02:00
88a0ed9736 Implement the IndexDeletion batch operation 2022-10-20 15:44:33 +02:00
4a53cb1c50 Implement the IndexUpdate batch operation 2022-10-20 15:44:33 +02:00
617994a9d7 Implement the IndexCreate batch operation 2022-10-20 15:44:33 +02:00
8bffe41886 Remove the IndexRename operation 2022-10-20 15:43:02 +02:00
78e730ca37 Add a TODO about the index creation 2022-10-20 15:43:02 +02:00
373995dca9 Make clippy happy 2022-10-20 15:43:02 +02:00
3fda1942c0 Implement a recursive indexation for the index-related operations 2022-10-20 15:43:02 +02:00
e7ca5efe1e Implement the SettingsAndDocumentImport batch operation 2022-10-20 15:43:01 +02:00
e24715abe5 Merge both DocumentAddition/Update into one DocumentImport variant 2022-10-20 15:43:01 +02:00
9e1d7fbfe5 Implement the DocumentClear batch operation 2022-10-20 15:43:01 +02:00
eb8dda1f81 Implement the DocumentClearAndSettings batch operation 2022-10-20 15:43:01 +02:00
ad0d285f12 Implement the Settings batch operation 2022-10-20 15:43:01 +02:00
e84119fc75 Implement the DocumentUpdate batch operation 2022-10-20 15:43:01 +02:00
78922a7c67 Implement the DocumentDeletion batch operation 2022-10-20 15:43:00 +02:00
5cd1fc0b7b remove an old unworking part of the batch execution 2022-10-20 15:42:45 +02:00
2d31cff082 get rids of meilisearch-lib 2022-10-20 15:42:44 +02:00