Commit Graph

316 Commits

Author SHA1 Message Date
be01a33cea Skip computing index budget in tests 2023-02-16 14:31:08 +01:00
d93a60c005 Compute budget 2023-02-16 10:53:57 +01:00
babfbd9c87 Add dichotomic search to utils 2023-02-16 10:53:57 +01:00
5daaf7cd5f Fix doc comment
Co-authored-by: Clément Renault <clement@meilisearch.com>
2023-02-16 10:53:57 +01:00
82ae5df706 Document generation and let it wrap-around as is it safe to do. 2023-02-16 10:53:57 +01:00
d3920a7e8a Retry in case of timeout while reopening 2023-02-16 10:53:57 +01:00
89e74dcc31 Change default index map size to 10GiB 2023-02-16 10:53:57 +01:00
a4d0a56fc4 Add basic tests for index eviction and resize 2023-02-16 10:53:57 +01:00
06fa22203b Fix TODO 2023-02-16 10:53:57 +01:00
52bf260f73 Rewrite where evicted indexes are added to the set 2023-02-16 10:53:57 +01:00
f3c3ccc4b3 WIP: evict indexes in unavailable 2023-02-16 10:53:57 +01:00
e6cd7a68cc Parameterize growth factor and index count 2023-02-16 10:53:57 +01:00
de771a8bd7 Use LRU cache 2023-02-16 10:53:56 +01:00
9107ac86f1 Add LruMap 2023-02-16 10:53:56 +01:00
3908fdec29 Make sure we don't leave the in memory hashmap in an inconsistent state 2023-02-16 10:53:41 +01:00
081dfb82ce Resize indexes when they're full 2023-02-16 10:53:41 +01:00
52bdccee77 Add IndexMapper::resize_index fn 2023-02-16 10:53:41 +01:00
380a2bec04 Add IndexStatus::BeingResized 2023-02-16 10:53:41 +01:00
7b30f3e4de IndexScheduler::tick returns a TickOutcome 2023-02-16 10:53:41 +01:00
4a792e6e98 create_or_open_index takes a map_size argument 2023-02-16 10:53:41 +01:00
ad70f461b5 Add Batch::index_uid 2023-02-16 10:53:41 +01:00
4570d5bf3a Merge remote-tracking branch 'origin/main' into temp-wildcard 2023-02-09 13:14:05 +01:00
a36b1dbd70 Fix the tasks with the new patterns 2023-02-01 18:21:45 +01:00
924d5d4c11 clippy: remove needless lifetimes 2023-01-31 10:40:48 +01:00
a858531574 apply review comments 2023-01-25 14:51:36 +01:00
bf94f89035 Update index-scheduler/src/lib.rs
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2023-01-25 11:31:50 +01:00
3bcff60d1c makes clippy happy 2023-01-25 11:31:48 +01:00
c92948b143 Compute the size of the auth-controller, index-scheduler and all update files in the global stats 2023-01-25 11:25:02 +01:00
c7b2e3be87 apply review comments 2023-01-24 17:54:43 +01:00
ea3b269b77 reformat 2023-01-23 23:59:34 +01:00
a4be4c49e8 Update index-scheduler/src/batch.rs
Co-authored-by: Clément Renault <clement@meilisearch.com>
2023-01-23 23:58:03 +01:00
7d1ebb7295 add test on the autobatcher layer 2023-01-23 20:56:12 +01:00
767cb725a5 reimplement the batching of task with or without primary key in the autobatcher 2023-01-23 20:18:22 +01:00
5672118bfa When adding documents, trying to update the primary-key now throw an error
While updating the test suite I also noticed an issue with the indexed_documents value of failed task and had to update it.
I also named a bunch of snapshots that had no name sorry 😬
2023-01-23 17:32:13 +01:00
72e2b220ed Fix tests 2023-01-19 15:48:20 +01:00
e8e7070cc6 improve the error message when no task filter are specified for the cancelation or deletion of tasks 2023-01-19 12:42:08 +01:00
3e5b3df487 Merge #3370 #3373 #3375
3370: make the swap indexes not found errors return an IndexNotFound error-code r=irevoire a=irevoire

Fix https://github.com/meilisearch/meilisearch/issues/3368

3373: fix a wrong error code and add tests on the document resource r=irevoire a=irevoire

Fix https://github.com/meilisearch/meilisearch/issues/3371

3375: Avoid deleting all task invalid canceled by r=irevoire a=Kerollmops

Fixes #3369 by making sure that at least one `canceledBy` task filter parameter matches something.

Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: Kerollmops <clement@meilisearch.com>
2023-01-18 15:21:11 +00:00
e89973f1bf Do not delete all tasks when no canceled-by matches 2023-01-18 15:50:46 +01:00
57da80900d make the swap indexes not found errors return an IndexNotFound error code 2023-01-18 14:16:00 +01:00
2bc2e99ff3 Simplify declaration of the error codes 2023-01-11 19:08:39 +01:00
e706628bb1 fix the error code of the swap index route 2023-01-06 14:48:25 +01:00
50ce0409bc Integrate deserr on the most important routes 2023-01-05 20:48:29 +01:00
2d74678b51 Replace underscores with hyphens in doc link to error code 2023-01-05 10:09:02 +01:00
233372abea Remove --max-index-size and --max-task-db-size 2023-01-04 17:20:01 +01:00
9a39c4e40d Get date from IndexMetaData 2022-12-22 11:46:17 +01:00
0893b175dc Merge branch 'main' into 2983-forward-date-to-milli 2022-12-21 14:31:19 +01:00
d5978d11e1 Refactor 2022-12-21 14:28:00 +01:00
d8fb506c92 handle most io error instead of tagging everything as an internal 2022-12-19 20:50:40 +01:00
aa03e02fdc Apply Rustfmt 2022-12-19 19:24:56 +01:00
869d331680 Clippy fixes after updating Rust to v1.66 2022-12-19 14:17:12 +01:00