Commit Graph

4268 Commits

Author SHA1 Message Date
ffd5cb5ad3 cargo fmt 2022-10-20 16:39:22 +02:00
5205c7dcc7 Fix date parsing for task queries
Use rfc3339 or YYYY-MM-DD.

Add a day to the parsed date when it is an excluded lower bound
and the YYYY-MM-DD was used.

Also the Query type does not need to be serialisable anymore
2022-10-20 16:39:22 +02:00
af508b9a81 Apply suggestions from code review
Co-authored-by: Clément Renault <clement@meilisearch.com>

Apply suggestions from code review

Co-authored-by: Clément Renault <clement@meilisearch.com>
Co-authored-by: Tamo <tamo@meilisearch.com>

Apply suggestions from code review

Co-authored-by: Clément Renault <clement@meilisearch.com>
Co-authored-by: Tamo <tamo@meilisearch.com>

Apply code review suggestion

Co-authored-by: Clément Renault <clement@meilisearch.com>
2022-10-20 16:39:22 +02:00
1eeef1c1c8 Implement task date filters
before/after enqueued/started/finished at
2022-10-20 16:39:21 +02:00
f3c2be1eb5 fix the auto-generated details 2022-10-20 16:37:29 +02:00
aa13fc448d remove the unused variants from the autobatcher 2022-10-20 16:37:29 +02:00
3702249b1a fix a bunch of snapshot tests 2022-10-20 16:37:29 +02:00
49b14064c2 fix the dumps tests since we added informations in the DumpTask 2022-10-20 16:37:28 +02:00
188e95d00f Delete the tasks content file once the transaction has been successfully committed 2022-10-20 16:37:28 +02:00
ad05bd9156 Remove the useless r#union thing 2022-10-20 16:37:28 +02:00
ea0dcf2c7c Clean up the delete_persisted_task_data function 2022-10-20 16:37:28 +02:00
0bbda61169 Throw the error if we can't register the tasks in the store 2022-10-20 16:37:28 +02:00
9945f984db Introduce a ProcessingTasks constructor 2022-10-20 16:37:27 +02:00
fd73306793 Extract the must_stop flag out of the RwLock 2022-10-20 16:37:27 +02:00
07db4cfab0 Prefer using an u64 instead of a usize in some places 2022-10-20 16:37:27 +02:00
cc6e2fd1e8 Delete the persisted data when we cancel a task 2022-10-20 16:37:27 +02:00
4f1c0535b4 Use a tokio block_in_place method for potentially blocking tasks 2022-10-20 16:37:27 +02:00
afafe8d207 Put the original URL query in the tasks details 2022-10-20 16:37:26 +02:00
973e2f71eb Add the tasks cancel route to cancel tasks 2022-10-20 16:37:26 +02:00
01ed1fb128 Update the canceledBy and finishedAt fields 2022-10-20 16:37:26 +02:00
74657bba2c Introduce the core algorithm of task cancelation 2022-10-20 16:37:26 +02:00
6276b2a382 Add more enum-iterator related stuff 2022-10-20 16:37:26 +02:00
607a0600e5 Prefer using TaskDeletion in the dumps 2022-10-20 16:35:06 +02:00
bcb7d1744a Introduce the task cancelation task type 2022-10-20 16:35:06 +02:00
4a7b5c7836 Add the canceled task status 2022-10-20 16:35:05 +02:00
b8803781dc Introduce the ProcessingTasks struct 2022-10-20 16:35:05 +02:00
47168c613d Use the indexation-abortion milli's branch 2022-10-20 16:35:05 +02:00
e7047e8377 Remove the meilisearch-auth milli dependency 2022-10-20 16:34:33 +02:00
baeb168b6e Delete a task's persisted data when appropriate 2022-10-20 16:34:32 +02:00
7308ccd530 make the tests compile again 2022-10-20 16:34:32 +02:00
656f809b1d fix the analytics 2022-10-20 16:26:17 +02:00
65e69c06bc extract the create_app function for the tests 2022-10-20 16:26:17 +02:00
aff67f78c1 bump enum-iter and fix a bunch of error messages 2022-10-20 16:24:23 +02:00
4921e926e5 fix meilisearch-http 2022-10-20 16:14:37 +02:00
99f1d5df20 fix the tests 2022-10-20 16:14:37 +02:00
0bde0abd74 share the rtxn between the access to the tasks and to the indexes 2022-10-20 16:14:37 +02:00
dbcc3456c6 dump the content of the dump tasks instead of recreating at import time with wrong API keys 2022-10-20 16:14:36 +02:00
09a0569228 remove useless todo 2022-10-20 16:14:36 +02:00
860d343831 get rids of the useless Seek before creating a grenad reader 2022-10-20 16:14:36 +02:00
8e469d8d1d flush the dump-writer only once everything has been inserted 2022-10-20 16:14:36 +02:00
b87b071718 apply most style comments of the review 2022-10-20 16:14:36 +02:00
e220cc2183 Update dump/src/error.rs
Co-authored-by: Clément Renault <clement@meilisearch.com>
2022-10-20 16:14:36 +02:00
458a531547 rebase on index-scheduler 2022-10-20 16:14:35 +02:00
6987bc185e fix a synchronization bug while importing tasks 2022-10-20 16:13:18 +02:00
a2384dc627 fix all the errors code and settings issues when importing a dump v2 2022-10-20 16:13:18 +02:00
bab0e050f1 fix all the error codes 2022-10-20 16:13:18 +02:00
748249578d commit after creating an index 2022-10-20 16:13:17 +02:00
54d4d364c2 fix the deletion of the data.ms in case of errors 2022-10-20 16:13:17 +02:00
9b96085327 the index-scheduler needs to wake-up after importing a dump 2022-10-20 16:13:17 +02:00
4c1c108a19 remove the dbg 2022-10-20 16:13:17 +02:00