Commit Graph

4267 Commits

Author SHA1 Message Date
8c9b758fa8 stop dumping the current dumping task as enqueued so it's not looping for ever 2022-10-20 16:13:17 +02:00
ede46b716c add a bufwriter on the documents 2022-10-20 16:13:16 +02:00
cac924b663 first mostly working version 2022-10-20 16:13:16 +02:00
6fae317277 update the API a little bit 2022-10-20 16:12:26 +02:00
1a3fea4d8c fix the tests 2022-10-20 16:12:26 +02:00
9323f9f1c4 write the dump export 2022-10-20 16:12:25 +02:00
7ce336306d Fix number of deleted tasks details after duplicate task deletion 2022-10-20 16:09:33 +02:00
d49d7e9c2d Add task deletion tests where the same task is deleted twice 2022-10-20 16:09:33 +02:00
dabc30d3d6 Return an error when calling DELETE /tasks with an empty query 2022-10-20 16:09:32 +02:00
9067148270 Apply suggested changes from PR review 2022-10-20 16:09:32 +02:00
4bd8607cf9 Avoid creating two read txn at the same time 2022-10-20 16:09:32 +02:00
4c6145f782 Update snapshot tests following git rebase that fixes a bug 2022-10-20 16:09:32 +02:00
012c3e986c Finish first draft of the DELETE /tasks route 2022-10-20 16:09:32 +02:00
ef3e9e87f5 Continue implementation of task deletion
1. Matched tasks are a roaring bitmap
2. Start implementation in meilisearch-http
3. Snapshots use meili-snap
4. Rename to TaskDeletion
2022-10-20 16:08:16 +02:00
7d4527728e Make sure that we do not batch tasks from different indexes 2022-10-20 16:00:58 +02:00
1c697edb95 Add a test to check different indexes autobatching 2022-10-20 16:00:58 +02:00
8433a432b1 Extract index creation rights and simplify the autobatcher rules 2022-10-20 16:00:58 +02:00
ea192d31f4 Fix invalid import of tasks types 2022-10-20 16:00:58 +02:00
dc1d739785 move the API key in meilisearch_types 2022-10-20 16:00:58 +02:00
c9050759f5 remove an unused file 2022-10-20 15:59:53 +02:00
c0a6f7a021 uncomment a task serialization test 2022-10-20 15:59:53 +02:00
e533e740d4 refactor the Task a little bit 2022-10-20 15:59:52 +02:00
e6c033bd6b start moving a lot of task types to meilisearch_types 2022-10-20 15:59:52 +02:00
974b40ba04 store md5 instead of the whole snapshots 2022-10-20 15:59:30 +02:00
d85451b8e5 Add meili-snap crate to make writing snapshot tests easier 2022-10-20 15:59:30 +02:00
8a32b766c6 fix all the import and comment most of the dump v6 2022-10-20 15:57:53 +02:00
d8bbe18d71 push the document_format and settings I forgot in the previous PR 2022-10-20 15:57:53 +02:00
f456fb5e0b get rids of the index crate + the document_types crate 2022-10-20 15:57:52 +02:00
f3ec39a769 Fix compiler errors related autobatching option of the index scheduler 2022-10-20 15:45:57 +02:00
8d0ebbc9fa Fix typo and remove useless code in tests 2022-10-20 15:45:57 +02:00
5914889a29 Apply suggestions from code review
Co-authored-by: Tamo <tamo@meilisearch.com>
2022-10-20 15:45:57 +02:00
ccfe1babdc Add more task deletion tests 2022-10-20 15:45:57 +02:00
570ae05833 Use more complete snapshot tests for the index scheduler 2022-10-20 15:45:57 +02:00
fd73e65165 Add a DetailsView type and improve index scheduler snapshots
The DetailsView type is necessary because serde incorrectly
deserialises the `Details` type, so the database fails to correctly
decode Tasks
2022-10-20 15:45:57 +02:00
05753c663f Implement TaskDeletion in the index scheduler 2022-10-20 15:44:58 +02:00
ee352b6c7c Allow a user to disable the auto batching system 2022-10-20 15:44:58 +02:00
21d6c03bb4 Add a test to check that it works without autobatching 2022-10-20 15:44:58 +02:00
12c374e475 Remove the IndexScheduler::notify method 2022-10-20 15:44:58 +02:00
fc148212aa Make sure that the index-scheduler tick loop is rerun after processing 2022-10-20 15:44:58 +02:00
67e8ee6ef7 Add a test that verifies that sending multiple tasks works 2022-10-20 15:44:57 +02:00
4777449cc3 remove unused files 2022-10-20 15:44:57 +02:00
baa67fade2 fix the tests 2022-10-20 15:44:57 +02:00
997e7450d4 write a bunch of tests that goes through the whole compat layers 2022-10-20 15:44:57 +02:00
bd509f3593 remove the warnings 2022-10-20 15:44:57 +02:00
704b9566e4 rewrite the update file API 2022-10-20 15:44:56 +02:00
d8ac2a0063 finish the dump reader API, the dump Writer API now needs to be updated 2022-10-20 15:44:56 +02:00
2db486ad90 start dumping the update files to a known format 2022-10-20 15:44:56 +02:00
170af0c9bd fix the compat between v3 and v4 2022-10-20 15:44:56 +02:00
392e2829f8 remove the ununsed snapshot files 2022-10-20 15:44:56 +02:00
50dfe06efe remove all warnings 2022-10-20 15:44:55 +02:00