Commit Graph

1035 Commits

Author SHA1 Message Date
e35bd263df Fix final compilation 2022-10-20 17:08:52 +02:00
cf58a76faf Fix the new config file with the index scheduler 2022-10-20 16:49:19 +02:00
22d514645e Don't return an error when swapping 0 indexes 2022-10-20 16:39:23 +02:00
14a44776f6 Implement POST /indexes-swap 2022-10-20 16:39:23 +02:00
835745ac22 Add some documentation to the index scheduler 2022-10-20 16:39:22 +02:00
5205c7dcc7 Fix date parsing for task queries
Use rfc3339 or YYYY-MM-DD.

Add a day to the parsed date when it is an excluded lower bound
and the YYYY-MM-DD was used.

Also the Query type does not need to be serialisable anymore
2022-10-20 16:39:22 +02:00
af508b9a81 Apply suggestions from code review
Co-authored-by: Clément Renault <clement@meilisearch.com>

Apply suggestions from code review

Co-authored-by: Clément Renault <clement@meilisearch.com>
Co-authored-by: Tamo <tamo@meilisearch.com>

Apply suggestions from code review

Co-authored-by: Clément Renault <clement@meilisearch.com>
Co-authored-by: Tamo <tamo@meilisearch.com>

Apply code review suggestion

Co-authored-by: Clément Renault <clement@meilisearch.com>
2022-10-20 16:39:22 +02:00
1eeef1c1c8 Implement task date filters
before/after enqueued/started/finished at
2022-10-20 16:39:21 +02:00
07db4cfab0 Prefer using an u64 instead of a usize in some places 2022-10-20 16:37:27 +02:00
4f1c0535b4 Use a tokio block_in_place method for potentially blocking tasks 2022-10-20 16:37:27 +02:00
afafe8d207 Put the original URL query in the tasks details 2022-10-20 16:37:26 +02:00
973e2f71eb Add the tasks cancel route to cancel tasks 2022-10-20 16:37:26 +02:00
01ed1fb128 Update the canceledBy and finishedAt fields 2022-10-20 16:37:26 +02:00
74657bba2c Introduce the core algorithm of task cancelation 2022-10-20 16:37:26 +02:00
bcb7d1744a Introduce the task cancelation task type 2022-10-20 16:35:06 +02:00
7308ccd530 make the tests compile again 2022-10-20 16:34:32 +02:00
656f809b1d fix the analytics 2022-10-20 16:26:17 +02:00
65e69c06bc extract the create_app function for the tests 2022-10-20 16:26:17 +02:00
4921e926e5 fix meilisearch-http 2022-10-20 16:14:37 +02:00
dbcc3456c6 dump the content of the dump tasks instead of recreating at import time with wrong API keys 2022-10-20 16:14:36 +02:00
860d343831 get rids of the useless Seek before creating a grenad reader 2022-10-20 16:14:36 +02:00
b87b071718 apply most style comments of the review 2022-10-20 16:14:36 +02:00
6987bc185e fix a synchronization bug while importing tasks 2022-10-20 16:13:18 +02:00
54d4d364c2 fix the deletion of the data.ms in case of errors 2022-10-20 16:13:17 +02:00
cac924b663 first mostly working version 2022-10-20 16:13:16 +02:00
9323f9f1c4 write the dump export 2022-10-20 16:12:25 +02:00
dabc30d3d6 Return an error when calling DELETE /tasks with an empty query 2022-10-20 16:09:32 +02:00
9067148270 Apply suggested changes from PR review 2022-10-20 16:09:32 +02:00
012c3e986c Finish first draft of the DELETE /tasks route 2022-10-20 16:09:32 +02:00
ef3e9e87f5 Continue implementation of task deletion
1. Matched tasks are a roaring bitmap
2. Start implementation in meilisearch-http
3. Snapshots use meili-snap
4. Rename to TaskDeletion
2022-10-20 16:08:16 +02:00
dc1d739785 move the API key in meilisearch_types 2022-10-20 16:00:58 +02:00
e533e740d4 refactor the Task a little bit 2022-10-20 15:59:52 +02:00
e6c033bd6b start moving a lot of task types to meilisearch_types 2022-10-20 15:59:52 +02:00
d85451b8e5 Add meili-snap crate to make writing snapshot tests easier 2022-10-20 15:59:30 +02:00
f456fb5e0b get rids of the index crate + the document_types crate 2022-10-20 15:57:52 +02:00
f3f6bbf624 Update the tasks statuses 2022-10-20 15:44:33 +02:00
4871509507 Make sure that meilisearch-http works without index wrapper 2022-10-20 15:44:33 +02:00
b7898cd4ab Implement ErrorCode on the heed Error 2022-10-20 15:44:33 +02:00
b83710ea98 Implement ErrorCode on the milli::Error type 2022-10-20 15:44:32 +02:00
373995dca9 Make clippy happy 2022-10-20 15:43:02 +02:00
248805d2df Fix meilisearch-http to use the new DocumentImport batch operation 2022-10-20 15:43:02 +02:00
0d0b2a9ac1 bring back the IndexMeta and IndexStats in meilisearch-http 2022-10-20 15:42:45 +02:00
f4ecf75cda fix import bug 2022-10-20 15:42:45 +02:00
2064b65d5f remove the create_app macro 2022-10-20 15:42:45 +02:00
2d31cff082 get rids of meilisearch-lib 2022-10-20 15:42:44 +02:00
42f5c1fc3f connect the new scheduler to meilisearch-http officially.
I can index documents and do search
2022-10-20 15:34:55 +02:00
f84cbee170 implements the get_tasks 2022-10-20 15:34:55 +02:00
5b282acb7b fix all compilation errors 2022-10-20 15:34:55 +02:00
60ee1f5e64 wip integrating the scheduler in meilisearch-http 2022-10-20 15:34:55 +02:00
b0749407f3 Merge #2804
2804: Add environement variable `MEILI_CONFIG_FILE_PATH` to define the config file path r=Kerollmops a=choznerol

# Pull Request

## What does this PR do?
Fixes #2800

~This is a draft PR base on the code in #2745. I will `rebase` and mark it ready for review only after #2745 merge.~ Done rebase


## PR checklist
Please check if your PR fulfills the following requirements:
- [x] Does this PR fix an existing issue?
- [x] Have you read the contributing guidelines?
- [x] Have you made sure that the title is accurate and descriptive of the changes?


## Demo

With `config.toml`, `config_copy1.toml` and `config_copy2.toml` present:
> <img width="692" alt="image" src="https://user-images.githubusercontent.com/12410942/192566891-6b3c9d26-736f-4e23-a09b-687fca1cb50d.png">

`MEILI_CONFIG_FILE_PATH` works:
> <img width="773" alt="image" src="https://user-images.githubusercontent.com/12410942/192567023-f751536e-992a-4e90-a176-cb19122248be.png">

`--config-file-path` still works:
> <img width="768" alt="image" src="https://user-images.githubusercontent.com/12410942/192567318-88c80b24-7873-4cec-8d08-16fe4d228055.png">

When both present, `--config-file-path` taks precedence:
> <img width="1214" alt="image" src="https://user-images.githubusercontent.com/12410942/192567477-8a7cffe1-96f0-42a9-a348-6dbec20dc1e7.png">



Co-authored-by: Lawrence Chou <choznerol@protonmail.com>
2022-10-17 10:40:05 +00:00