Commit Graph

59 Commits

Author SHA1 Message Date
cac924b663 first mostly working version 2022-10-20 16:13:16 +02:00
6fae317277 update the API a little bit 2022-10-20 16:12:26 +02:00
1a3fea4d8c fix the tests 2022-10-20 16:12:26 +02:00
9323f9f1c4 write the dump export 2022-10-20 16:12:25 +02:00
7ce336306d Fix number of deleted tasks details after duplicate task deletion 2022-10-20 16:09:33 +02:00
d49d7e9c2d Add task deletion tests where the same task is deleted twice 2022-10-20 16:09:33 +02:00
9067148270 Apply suggested changes from PR review 2022-10-20 16:09:32 +02:00
012c3e986c Finish first draft of the DELETE /tasks route 2022-10-20 16:09:32 +02:00
ef3e9e87f5 Continue implementation of task deletion
1. Matched tasks are a roaring bitmap
2. Start implementation in meilisearch-http
3. Snapshots use meili-snap
4. Rename to TaskDeletion
2022-10-20 16:08:16 +02:00
7d4527728e Make sure that we do not batch tasks from different indexes 2022-10-20 16:00:58 +02:00
e533e740d4 refactor the Task a little bit 2022-10-20 15:59:52 +02:00
e6c033bd6b start moving a lot of task types to meilisearch_types 2022-10-20 15:59:52 +02:00
f456fb5e0b get rids of the index crate + the document_types crate 2022-10-20 15:57:52 +02:00
5914889a29 Apply suggestions from code review
Co-authored-by: Tamo <tamo@meilisearch.com>
2022-10-20 15:45:57 +02:00
fd73e65165 Add a DetailsView type and improve index scheduler snapshots
The DetailsView type is necessary because serde incorrectly
deserialises the `Details` type, so the database fails to correctly
decode Tasks
2022-10-20 15:45:57 +02:00
05753c663f Implement TaskDeletion in the index scheduler 2022-10-20 15:44:58 +02:00
ee352b6c7c Allow a user to disable the auto batching system 2022-10-20 15:44:58 +02:00
a358eaa816 Create the index only if the task has the rights to do so 2022-10-20 15:44:35 +02:00
134634d99a Correctly batch tasks with different index creation rights 2022-10-20 15:44:35 +02:00
be192f281d Only mark the first clear document with the amount of cleared documents 2022-10-20 15:44:34 +02:00
99d1e9a870 Let the tick function set the Failed status itself 2022-10-20 15:44:34 +02:00
945cb00fc3 Fill an IndexDeletion task with the number of documents removed 2022-10-20 15:44:34 +02:00
b7ad050737 Panic if we encountered a wring KindWithContent type 2022-10-20 15:44:34 +02:00
f3f6bbf624 Update the tasks statuses 2022-10-20 15:44:33 +02:00
88a0ed9736 Implement the IndexDeletion batch operation 2022-10-20 15:44:33 +02:00
4a53cb1c50 Implement the IndexUpdate batch operation 2022-10-20 15:44:33 +02:00
617994a9d7 Implement the IndexCreate batch operation 2022-10-20 15:44:33 +02:00
8bffe41886 Remove the IndexRename operation 2022-10-20 15:43:02 +02:00
78e730ca37 Add a TODO about the index creation 2022-10-20 15:43:02 +02:00
373995dca9 Make clippy happy 2022-10-20 15:43:02 +02:00
3fda1942c0 Implement a recursive indexation for the index-related operations 2022-10-20 15:43:02 +02:00
e7ca5efe1e Implement the SettingsAndDocumentImport batch operation 2022-10-20 15:43:01 +02:00
e24715abe5 Merge both DocumentAddition/Update into one DocumentImport variant 2022-10-20 15:43:01 +02:00
9e1d7fbfe5 Implement the DocumentClear batch operation 2022-10-20 15:43:01 +02:00
eb8dda1f81 Implement the DocumentClearAndSettings batch operation 2022-10-20 15:43:01 +02:00
ad0d285f12 Implement the Settings batch operation 2022-10-20 15:43:01 +02:00
e84119fc75 Implement the DocumentUpdate batch operation 2022-10-20 15:43:01 +02:00
78922a7c67 Implement the DocumentDeletion batch operation 2022-10-20 15:43:00 +02:00
5cd1fc0b7b remove an old unworking part of the batch execution 2022-10-20 15:42:45 +02:00
2d31cff082 get rids of meilisearch-lib 2022-10-20 15:42:44 +02:00
2de8f08517 fix a deadlock 2022-10-20 15:36:10 +02:00
60ee1f5e64 wip integrating the scheduler in meilisearch-http 2022-10-20 15:34:55 +02:00
16eab7b337 I can index documents without meilisearch 2022-10-20 15:30:20 +02:00
7bbd75e1fb wip 2022-10-20 15:29:48 +02:00
a4bf859779 create the end Batch type for all Index* operations 2022-10-20 15:29:48 +02:00
72496122c3 create the end Batch type for all Document* operation 2022-10-20 15:29:48 +02:00
d7146d7b21 write most of the run loop 2022-10-20 15:29:48 +02:00
f84ced7e38 start integrating the index-scheduler in the meilisearch codebase 2022-10-20 15:28:50 +02:00
9882b7fa57 greatly reduce the number of warnings 2022-10-20 15:26:57 +02:00
1a4461cd3a fix smol typo 2022-10-20 15:26:57 +02:00