90f1334757
Compress the snapshot in a tarball
2022-10-26 11:33:27 +02:00
19910f912d
Reintroduce the versioning functions
2022-10-26 11:33:27 +02:00
5151bde209
Declare the auth path in the index scheduler
2022-10-26 11:33:27 +02:00
67566af599
Implement a first version of the snapshots
2022-10-26 11:33:27 +02:00
43aa3ce1c7
Add the snapshots directory path to the IndexScheduler
2022-10-26 11:33:27 +02:00
e65f82bc86
Rename the Snapshot task into SnapshotCreation
2022-10-26 11:33:27 +02:00
c2842ad25f
Rename the index-scheduler module into insta_snapshot
2022-10-26 11:33:27 +02:00
7b3f156d03
Make sure that we don't delete or cancel future tasks
...
This should already have been the case before, but there is no harm
in adding another check.
2022-10-25 16:32:43 +02:00
73b2f25f55
fix an issue with the dates
2022-10-25 15:46:36 +02:00
56fbe147ac
add more naive tests around the document addition + remove the old unused snapshot files
2022-10-25 15:46:36 +02:00
b08cd4bd0c
add some naive document addition tests
2022-10-25 15:46:36 +02:00
513544c1f3
Add index scheduler tests for task cancelation
2022-10-25 12:35:11 +02:00
0218d94054
Merge pull request #2956 from meilisearch/index-swap-empty-crash
...
Fix crash when batching an index swap task containing 0 swaps
2022-10-25 11:12:35 +02:00
37119d1295
reformat
2022-10-25 10:59:06 +02:00
8d5d92f927
Fix crash when batching an index swap task containing 0 swaps
2022-10-25 10:57:03 +02:00
2a1f4ac4d9
remove a lot of unecessary clone and ref
2022-10-25 10:53:29 +02:00
6f418e73d0
Apply code review suggestions
2022-10-25 10:47:36 +02:00
c0a58f9141
Pause the index scheduler for one second when a fatal error occurs
2022-10-25 10:47:36 +02:00
44b8c8b713
Fix (hopefully) queries that include processing tasks
2022-10-25 10:47:36 +02:00
c562e380a0
Adjust task details correctly following index swap
2022-10-25 10:47:36 +02:00
dd7d758a6f
Start testing unexpected errors and panics in index scheduler
2022-10-25 10:47:36 +02:00
6d9140115f
Add assert method to verify validity of index scheduler state
2022-10-25 10:47:36 +02:00
3e45fdf7c5
rename the dumpExport to dumpCreation
2022-10-24 19:08:15 +02:00
3f5622f749
fix the task view and forward the task db size
2022-10-23 11:23:24 +02:00
3a95e6291e
remove ununsed function
2022-10-22 17:05:33 +02:00
3283bb0454
fix clippy
2022-10-22 17:04:47 +02:00
d065a3e4f0
fix the import of the dumpv4&v5 when there is no instance-uid + rename the Kind+KindWithContent+Details variant for the DocumentImport and the Setting
2022-10-22 16:07:55 +02:00
3f6bd7fb11
Introduce a rustfmt file
2022-10-20 18:00:07 +02:00
f1acafcf1c
fix the index deletion when the index doesn’t exists but would be created by one of the autobatched tasks
2022-10-20 16:39:24 +02:00
8514c1c12b
Apply review suggestions and stop using rtxn.commit
2022-10-20 16:39:23 +02:00
14a44776f6
Implement POST /indexes-swap
2022-10-20 16:39:23 +02:00
835745ac22
Add some documentation to the index scheduler
2022-10-20 16:39:22 +02:00
5205c7dcc7
Fix date parsing for task queries
...
Use rfc3339 or YYYY-MM-DD.
Add a day to the parsed date when it is an excluded lower bound
and the YYYY-MM-DD was used.
Also the Query type does not need to be serialisable anymore
2022-10-20 16:39:22 +02:00
1eeef1c1c8
Implement task date filters
...
before/after enqueued/started/finished at
2022-10-20 16:39:21 +02:00
f3c2be1eb5
fix the auto-generated details
2022-10-20 16:37:29 +02:00
ea0dcf2c7c
Clean up the delete_persisted_task_data function
2022-10-20 16:37:28 +02:00
0bbda61169
Throw the error if we can't register the tasks in the store
2022-10-20 16:37:28 +02:00
9945f984db
Introduce a ProcessingTasks constructor
2022-10-20 16:37:27 +02:00
fd73306793
Extract the must_stop flag out of the RwLock
2022-10-20 16:37:27 +02:00
973e2f71eb
Add the tasks cancel route to cancel tasks
2022-10-20 16:37:26 +02:00
01ed1fb128
Update the canceledBy and finishedAt fields
2022-10-20 16:37:26 +02:00
6276b2a382
Add more enum-iterator related stuff
2022-10-20 16:37:26 +02:00
607a0600e5
Prefer using TaskDeletion in the dumps
2022-10-20 16:35:06 +02:00
bcb7d1744a
Introduce the task cancelation task type
2022-10-20 16:35:06 +02:00
b8803781dc
Introduce the ProcessingTasks struct
2022-10-20 16:35:05 +02:00
baeb168b6e
Delete a task's persisted data when appropriate
2022-10-20 16:34:32 +02:00
99f1d5df20
fix the tests
2022-10-20 16:14:37 +02:00
dbcc3456c6
dump the content of the dump tasks instead of recreating at import time with wrong API keys
2022-10-20 16:14:36 +02:00
09a0569228
remove useless todo
2022-10-20 16:14:36 +02:00
b87b071718
apply most style comments of the review
2022-10-20 16:14:36 +02:00
