4f4fc20acf
Make clippy happy
2022-10-27 13:00:30 +02:00
78ffa00f98
Move index swap error handling from meilisearch-http to index-scheduler
...
And make index_not_found error asynchronous, since we can't know
whether the index will exist by the time the index swap task is
processed.
Improve the index-swap test to verify that future tasks are not swapped
and to test the new error messages that were introduced.
2022-10-27 11:45:38 +02:00
7b93ba40bd
Reimplement task queries to account for special index swap rules
2022-10-27 11:44:51 +02:00
7c908fadcf
Remove a useless clippy silence
2022-10-27 11:35:21 +02:00
8ec3681cf8
fix clippy part1
2022-10-27 11:35:20 +02:00
2ba5e3b519
Clean up some code
2022-10-27 11:35:20 +02:00
4e1b6b514e
update reviewer change
2022-10-27 11:35:19 +02:00
1f75caae88
Fix a few index swap bugs.
...
1. Details of the indexSwap task
2. Query tasks with type=indexUid
3. Synchronous error message for multiple index not found
2022-10-27 11:35:17 +02:00
a3fc0d3bd9
Fix the last regression
2022-10-27 11:35:17 +02:00
2f577b6fcd
Patch the IndexScheduler in meilisearch-http to use the options struct
2022-10-27 11:35:16 +02:00
71b50853dc
Introduce an options struct to create the IndexScheduler
2022-10-27 11:35:16 +02:00
e35fe33712
Fix some bugs with files
2022-10-27 11:35:15 +02:00
942b7c338b
Compress the snapshot in a tarball
2022-10-27 11:35:15 +02:00
4cafc63561
Reintroduce the versioning functions
2022-10-27 11:35:14 +02:00
89e127e4f4
Declare the auth path in the index scheduler
2022-10-27 11:35:14 +02:00
eec43ec953
Implement a first version of the snapshots
2022-10-27 11:35:14 +02:00
c063f154fb
Add the snapshots directory path to the IndexScheduler
2022-10-27 11:35:14 +02:00
e0548e42e7
Rename the Snapshot task into SnapshotCreation
2022-10-27 11:35:14 +02:00
4d43a9f5b1
Rename the index-scheduler module into insta_snapshot
2022-10-27 11:35:14 +02:00
6db90ba6cc
Make sure that we don't delete or cancel future tasks
...
This should already have been the case before, but there is no harm
in adding another check.
2022-10-27 11:35:13 +02:00
61f0940f8c
fix an issue with the dates
2022-10-27 11:35:13 +02:00
241300d2d8
add more naive tests around the document addition + remove the old unused snapshot files
2022-10-27 11:35:13 +02:00
570b2d1167
add some naive document addition tests
2022-10-27 11:35:12 +02:00
d92425658e
Add index scheduler tests for task cancelation
2022-10-27 11:35:12 +02:00
16fac10074
Fix crash when batching an index swap task containing 0 swaps
2022-10-27 11:35:12 +02:00
7ed3f00b1e
reformat
2022-10-27 11:35:12 +02:00
7e52f1effb
remove a lot of unecessary clone and ref
2022-10-27 11:35:11 +02:00
4d25c159e6
Apply code review suggestions
2022-10-27 11:35:11 +02:00
424202d773
Pause the index scheduler for one second when a fatal error occurs
2022-10-27 11:35:11 +02:00
4a35eb9849
Fix (hopefully) queries that include processing tasks
2022-10-27 11:35:11 +02:00
493a8cff31
Adjust task details correctly following index swap
2022-10-27 11:35:10 +02:00
4de445d386
Start testing unexpected errors and panics in index scheduler
2022-10-27 11:35:10 +02:00
e3848b5f28
Add assert method to verify validity of index scheduler state
2022-10-27 11:35:10 +02:00
ecf4e43b3d
rename the dumpExport to dumpCreation
2022-10-27 11:35:10 +02:00
8a23e707c1
fix the task view and forward the task db size
2022-10-27 11:35:09 +02:00
1d04ce611d
remove ununsed function
2022-10-27 11:35:08 +02:00
e9055f5572
fix clippy
2022-10-27 11:35:08 +02:00
8d1408c65e
fix the import of the dumpv4&v5 when there is no instance-uid + rename the Kind+KindWithContent+Details variant for the DocumentImport and the Setting
2022-10-27 11:35:05 +02:00
80b2e70ee7
Introduce a rustfmt file
2022-10-27 11:35:05 +02:00
b6a0abea9f
fix the index deletion when the index doesn’t exists but would be created by one of the autobatched tasks
2022-10-27 11:34:16 +02:00
11fee30f47
Apply review suggestions and stop using rtxn.commit
2022-10-27 11:34:15 +02:00
17cd2a4aa0
Implement POST /indexes-swap
2022-10-27 11:34:15 +02:00
169f386418
Add some documentation to the index scheduler
2022-10-27 11:34:15 +02:00
ec3391808d
Fix date parsing for task queries
...
Use rfc3339 or YYYY-MM-DD.
Add a day to the parsed date when it is an excluded lower bound
and the YYYY-MM-DD was used.
Also the Query type does not need to be serialisable anymore
2022-10-27 11:34:14 +02:00
22cf0559fe
Implement task date filters
...
before/after enqueued/started/finished at
2022-10-27 11:34:14 +02:00
5765883600
fix the auto-generated details
2022-10-27 11:34:14 +02:00
6460b78e08
Clean up the delete_persisted_task_data function
2022-10-27 11:34:13 +02:00
d21651c968
Throw the error if we can't register the tasks in the store
2022-10-27 11:34:13 +02:00
6e904d0997
Introduce a ProcessingTasks constructor
2022-10-27 11:34:12 +02:00
b373d19831
Extract the must_stop flag out of the RwLock
2022-10-27 11:34:12 +02:00
