6db90ba6cc
Make sure that we don't delete or cancel future tasks
...
This should already have been the case before, but there is no harm
in adding another check.
2022-10-27 11:35:13 +02:00
61f0940f8c
fix an issue with the dates
2022-10-27 11:35:13 +02:00
241300d2d8
add more naive tests around the document addition + remove the old unused snapshot files
2022-10-27 11:35:13 +02:00
570b2d1167
add some naive document addition tests
2022-10-27 11:35:12 +02:00
d92425658e
Add index scheduler tests for task cancelation
2022-10-27 11:35:12 +02:00
16fac10074
Fix crash when batching an index swap task containing 0 swaps
2022-10-27 11:35:12 +02:00
7ed3f00b1e
reformat
2022-10-27 11:35:12 +02:00
7e52f1effb
remove a lot of unecessary clone and ref
2022-10-27 11:35:11 +02:00
4d25c159e6
Apply code review suggestions
2022-10-27 11:35:11 +02:00
424202d773
Pause the index scheduler for one second when a fatal error occurs
2022-10-27 11:35:11 +02:00
4a35eb9849
Fix (hopefully) queries that include processing tasks
2022-10-27 11:35:11 +02:00
493a8cff31
Adjust task details correctly following index swap
2022-10-27 11:35:10 +02:00
4de445d386
Start testing unexpected errors and panics in index scheduler
2022-10-27 11:35:10 +02:00
e3848b5f28
Add assert method to verify validity of index scheduler state
2022-10-27 11:35:10 +02:00
ecf4e43b3d
rename the dumpExport to dumpCreation
2022-10-27 11:35:10 +02:00
8a23e707c1
fix the task view and forward the task db size
2022-10-27 11:35:09 +02:00
1d04ce611d
remove ununsed function
2022-10-27 11:35:08 +02:00
e9055f5572
fix clippy
2022-10-27 11:35:08 +02:00
8d1408c65e
fix the import of the dumpv4&v5 when there is no instance-uid + rename the Kind+KindWithContent+Details variant for the DocumentImport and the Setting
2022-10-27 11:35:05 +02:00
80b2e70ee7
Introduce a rustfmt file
2022-10-27 11:35:05 +02:00
b6a0abea9f
fix the index deletion when the index doesn’t exists but would be created by one of the autobatched tasks
2022-10-27 11:34:16 +02:00
11fee30f47
Apply review suggestions and stop using rtxn.commit
2022-10-27 11:34:15 +02:00
17cd2a4aa0
Implement POST /indexes-swap
2022-10-27 11:34:15 +02:00
169f386418
Add some documentation to the index scheduler
2022-10-27 11:34:15 +02:00
ec3391808d
Fix date parsing for task queries
...
Use rfc3339 or YYYY-MM-DD.
Add a day to the parsed date when it is an excluded lower bound
and the YYYY-MM-DD was used.
Also the Query type does not need to be serialisable anymore
2022-10-27 11:34:14 +02:00
22cf0559fe
Implement task date filters
...
before/after enqueued/started/finished at
2022-10-27 11:34:14 +02:00
5765883600
fix the auto-generated details
2022-10-27 11:34:14 +02:00
6460b78e08
Clean up the delete_persisted_task_data function
2022-10-27 11:34:13 +02:00
d21651c968
Throw the error if we can't register the tasks in the store
2022-10-27 11:34:13 +02:00
6e904d0997
Introduce a ProcessingTasks constructor
2022-10-27 11:34:12 +02:00
b373d19831
Extract the must_stop flag out of the RwLock
2022-10-27 11:34:12 +02:00
751e9bac3b
Add the tasks cancel route to cancel tasks
2022-10-27 11:34:11 +02:00
290945e258
Update the canceledBy and finishedAt fields
2022-10-27 11:34:11 +02:00
b2c5bc67b7
Add more enum-iterator related stuff
2022-10-27 11:34:11 +02:00
591527a99d
Prefer using TaskDeletion in the dumps
2022-10-27 11:34:11 +02:00
1ca9a67c49
Introduce the task cancelation task type
2022-10-27 11:34:11 +02:00
703ba7a1fb
Introduce the ProcessingTasks struct
2022-10-27 11:34:10 +02:00
ea60d35c71
Delete a task's persisted data when appropriate
2022-10-27 11:34:10 +02:00
9e85f050b2
fix the tests
2022-10-27 11:34:09 +02:00
6bd6321226
dump the content of the dump tasks instead of recreating at import time with wrong API keys
2022-10-27 11:34:08 +02:00
655705eb2b
remove useless todo
2022-10-27 11:34:08 +02:00
78ce29f461
apply most style comments of the review
2022-10-27 11:34:08 +02:00
d0e91555d1
rebase on index-scheduler
2022-10-27 11:34:08 +02:00
e0221fc0a3
fix a synchronization bug while importing tasks
2022-10-27 11:34:07 +02:00
ba150f2127
commit after creating an index
2022-10-27 11:34:07 +02:00
e9295c03ce
the index-scheduler needs to wake-up after importing a dump
2022-10-27 11:34:06 +02:00
d481669b7e
fix the content_file import
2022-10-27 11:34:06 +02:00
d976e680c5
first mostly working version
2022-10-27 11:34:06 +02:00
c051166bcc
update the API a little bit
2022-10-27 11:34:05 +02:00
b7f9c94f4a
write the dump export
2022-10-27 11:34:05 +02:00
