be01a33cea
Skip computing index budget in tests
2023-02-16 14:31:08 +01:00
d93a60c005
Compute budget
2023-02-16 10:53:57 +01:00
babfbd9c87
Add dichotomic search to utils
2023-02-16 10:53:57 +01:00
5daaf7cd5f
Fix doc comment
...
Co-authored-by: Clément Renault <clement@meilisearch.com >
2023-02-16 10:53:57 +01:00
82ae5df706
Document generation and let it wrap-around as is it safe to do.
2023-02-16 10:53:57 +01:00
d3920a7e8a
Retry in case of timeout while reopening
2023-02-16 10:53:57 +01:00
89e74dcc31
Change default index map size to 10GiB
2023-02-16 10:53:57 +01:00
a4d0a56fc4
Add basic tests for index eviction and resize
2023-02-16 10:53:57 +01:00
06fa22203b
Fix TODO
2023-02-16 10:53:57 +01:00
52bf260f73
Rewrite where evicted indexes are added to the set
2023-02-16 10:53:57 +01:00
f3c3ccc4b3
WIP: evict indexes in unavailable
2023-02-16 10:53:57 +01:00
e6cd7a68cc
Parameterize growth factor and index count
2023-02-16 10:53:57 +01:00
de771a8bd7
Use LRU cache
2023-02-16 10:53:56 +01:00
9107ac86f1
Add LruMap
2023-02-16 10:53:56 +01:00
3908fdec29
Make sure we don't leave the in memory hashmap in an inconsistent state
2023-02-16 10:53:41 +01:00
081dfb82ce
Resize indexes when they're full
2023-02-16 10:53:41 +01:00
52bdccee77
Add IndexMapper::resize_index fn
2023-02-16 10:53:41 +01:00
380a2bec04
Add IndexStatus::BeingResized
2023-02-16 10:53:41 +01:00
7b30f3e4de
IndexScheduler::tick returns a TickOutcome
2023-02-16 10:53:41 +01:00
4a792e6e98
create_or_open_index
takes a map_size
argument
2023-02-16 10:53:41 +01:00
ad70f461b5
Add Batch::index_uid
2023-02-16 10:53:41 +01:00
4570d5bf3a
Merge remote-tracking branch 'origin/main' into temp-wildcard
2023-02-09 13:14:05 +01:00
a36b1dbd70
Fix the tasks with the new patterns
2023-02-01 18:21:45 +01:00
924d5d4c11
clippy: remove needless lifetimes
2023-01-31 10:40:48 +01:00
a858531574
apply review comments
2023-01-25 14:51:36 +01:00
bf94f89035
Update index-scheduler/src/lib.rs
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com >
2023-01-25 11:31:50 +01:00
3bcff60d1c
makes clippy happy
2023-01-25 11:31:48 +01:00
c92948b143
Compute the size of the auth-controller, index-scheduler and all update files in the global stats
2023-01-25 11:25:02 +01:00
c7b2e3be87
apply review comments
2023-01-24 17:54:43 +01:00
ea3b269b77
reformat
2023-01-23 23:59:34 +01:00
a4be4c49e8
Update index-scheduler/src/batch.rs
...
Co-authored-by: Clément Renault <clement@meilisearch.com >
2023-01-23 23:58:03 +01:00
7d1ebb7295
add test on the autobatcher layer
2023-01-23 20:56:12 +01:00
767cb725a5
reimplement the batching of task with or without primary key in the autobatcher
2023-01-23 20:18:22 +01:00
5672118bfa
When adding documents, trying to update the primary-key now throw an error
...
While updating the test suite I also noticed an issue with the indexed_documents value of failed task and had to update it.
I also named a bunch of snapshots that had no name sorry 😬
2023-01-23 17:32:13 +01:00
72e2b220ed
Fix tests
2023-01-19 15:48:20 +01:00
e8e7070cc6
improve the error message when no task filter are specified for the cancelation or deletion of tasks
2023-01-19 12:42:08 +01:00
3e5b3df487
Merge #3370 #3373 #3375
...
3370: make the swap indexes not found errors return an IndexNotFound error-code r=irevoire a=irevoire
Fix https://github.com/meilisearch/meilisearch/issues/3368
3373: fix a wrong error code and add tests on the document resource r=irevoire a=irevoire
Fix https://github.com/meilisearch/meilisearch/issues/3371
3375: Avoid deleting all task invalid canceled by r=irevoire a=Kerollmops
Fixes #3369 by making sure that at least one `canceledBy` task filter parameter matches something.
Co-authored-by: Tamo <tamo@meilisearch.com >
Co-authored-by: Kerollmops <clement@meilisearch.com >
2023-01-18 15:21:11 +00:00
e89973f1bf
Do not delete all tasks when no canceled-by matches
2023-01-18 15:50:46 +01:00
57da80900d
make the swap indexes not found errors return an IndexNotFound error code
2023-01-18 14:16:00 +01:00
2bc2e99ff3
Simplify declaration of the error codes
2023-01-11 19:08:39 +01:00
e706628bb1
fix the error code of the swap index route
2023-01-06 14:48:25 +01:00
50ce0409bc
Integrate deserr on the most important routes
2023-01-05 20:48:29 +01:00
2d74678b51
Replace underscores with hyphens in doc link to error code
2023-01-05 10:09:02 +01:00
233372abea
Remove --max-index-size
and --max-task-db-size
2023-01-04 17:20:01 +01:00
9a39c4e40d
Get date from IndexMetaData
2022-12-22 11:46:17 +01:00
0893b175dc
Merge branch 'main' into 2983-forward-date-to-milli
2022-12-21 14:31:19 +01:00
d5978d11e1
Refactor
2022-12-21 14:28:00 +01:00
d8fb506c92
handle most io error instead of tagging everything as an internal
2022-12-19 20:50:40 +01:00
aa03e02fdc
Apply Rustfmt
2022-12-19 19:24:56 +01:00
869d331680
Clippy fixes after updating Rust to v1.66
2022-12-19 14:17:12 +01:00