c1eba66443
introduce a corruption in the v1.12 data.ms field distribution
2025-01-23 16:51:24 +01:00
7197ced673
fix the bad index version on opening
2025-01-23 16:51:24 +01:00
4f21ee6c66
update the data.ms snapshot
2025-01-23 16:51:24 +01:00
787472453d
write the version of the index while upgrading it
2025-01-23 16:51:24 +01:00
8f65f35de9
rewrite part of the index-scheduler upgrade test
2025-01-23 16:51:23 +01:00
c27c923439
introduce a trait to upgrade the indexes
2025-01-23 16:51:23 +01:00
fd5649091d
add the upgradeTo field in the details
2025-01-23 16:51:23 +01:00
9a57736773
fix the early exit when rewriting a batch
2025-01-23 16:51:23 +01:00
7740997ea8
reintroduce the unrecoverable error and use it where its supposed to be used
2025-01-23 16:51:22 +01:00
7eb23f73ba
add the version to the index-scheduler snapshots + fix a bug when opening an index scheduler for the first time
2025-01-23 16:51:22 +01:00
b9e9fc376a
add the version in the index-scheduler
2025-01-23 16:51:22 +01:00
27bf2f1298
remove the empty progress made for the upgrade database
2025-01-23 16:51:22 +01:00
d4d82fbd0c
commit the index wtxn before the index-scheduler wtxn
2025-01-23 16:51:21 +01:00
eda09a54da
improve the index-scheduler tests
2025-01-23 16:51:21 +01:00
b132d70413
fix the details in all cases
2025-01-23 16:51:21 +01:00
e41ebd3047
expose the number of database in the index-scheduler and rewrite the lib.rs to use the value provided in the options instead of a magic number
2025-01-23 16:51:21 +01:00
705d31e8bd
apply all the comments changes
2025-01-23 16:51:21 +01:00
7d95950ce6
fix warning
2025-01-23 16:51:21 +01:00
c6b4c21c23
update the snapshots after the rebase
2025-01-23 16:51:20 +01:00
bf96fdb858
update the cli url
2025-01-23 16:51:20 +01:00
41eeffd88d
fmt
2025-01-23 16:51:20 +01:00
1eb9fe8562
remove warnings
2025-01-23 16:51:20 +01:00
bac7a1623a
fix the upgrade test
2025-01-23 16:51:19 +01:00
5458850d21
write a test ensuring the index-scheduler is effectively down when the upgrade task fail and try to process it when it restarts. There is a bug when deleting this task
2025-01-23 16:51:19 +01:00
20ac59c946
fix the field distribution when upgrading from the v1_12
2025-01-23 16:51:19 +01:00
cfc1e193b6
update the test with the stats
2025-01-23 16:51:19 +01:00
0cc25c7e4c
add a large test importing a data.ms from the v1.12.0
2025-01-23 16:51:18 +01:00
102681e384
starts adding tests and fix the starts of meilisearch
2025-01-23 16:51:18 +01:00
3ef7a478cd
move the version check to the task queue
2025-01-23 16:48:32 +01:00
e70ac35e02
fix bugs after rebase
2025-01-23 16:48:32 +01:00
d3654906bf
Add the new tasks with most of the job done
2025-01-23 16:48:32 +01:00
e6295c9c5f
Introduce a meilitool subcommand to compact an index
2025-01-22 16:37:00 +01:00
b15de68831
Merge #5257
...
Indexing bench (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of indexing (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of search for geo (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of search for songs (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of search for Wikipedia articles (push) / Run and upload benchmarks (push) Waiting to run
Test suite / Tests on ubuntu-20.04 (push) Failing after 0s
Test suite / Tests almost all features (push) Has been skipped
Test suite / Test disabled tokenization (push) Has been skipped
Test suite / Run tests in debug (push) Failing after 11s
Test suite / Run Clippy (push) Failing after 11s
Test suite / Tests on windows-2022 (push) Failing after 43s
Test suite / Run Rustfmt (push) Successful in 2m21s
Run the indexing fuzzer / Setup the action (push) Successful in 1h5m6s
Test suite / Tests on macos-13 (push) Has been cancelled
5257: Fix ollama r=Kerollmops a=dureuill
Fix oversight in ollama embedder
WIP Integration tests are on branch `ollama-integration-test` and will be added as a future PR.
Co-authored-by: Louis Dureuil <louis@meilisearch.com >
2025-01-22 15:36:15 +00:00
50fca8fc70
Create update files in new format
2025-01-22 15:51:21 +01:00
b9d92c481b
Update version for the next release (v1.12.6) in Cargo.toml
2025-01-22 15:51:20 +01:00
d142c5e432
Do not panic when the facet string is not found
2025-01-22 15:50:43 +01:00
4d4683adb6
Add a test to check the facet casing is good
2025-01-22 15:50:42 +01:00
d6063079af
Unify facet strings by their normalized value
2025-01-22 15:50:42 +01:00
2e04ab4737
Replace guards by OR patterns
...
Co-authored-by: Tamo <tamo@meilisearch.com >
2025-01-22 15:50:42 +01:00
d95384a636
Remove batch ids on export
2025-01-22 15:50:42 +01:00
c0690f5b9e
Make offline upgrade more flexible
2025-01-22 15:50:42 +01:00
909d84447d
meilitool dumps old-style dump for older DBs, otherwise new-style
2025-01-22 15:50:42 +01:00
2cf57d584e
Handle empty payloads
2025-01-22 15:50:42 +01:00
59242b9c4f
Fix warnings
2025-01-22 15:50:42 +01:00
6a6212d4e1
Fix warnings
2025-01-22 15:50:42 +01:00
a8006a3750
Change format of update file when importing dump
2025-01-22 15:50:41 +01:00
0e0e462f5b
Also fix dump import from meilitool
2025-01-22 15:50:41 +01:00
805531c90d
Do not explode on missing content file if the task has no docs
2025-01-22 15:50:41 +01:00
a6470a0c37
Improve error log
2025-01-22 15:50:41 +01:00
8a54f14b8e
Demote panic to error log
2025-01-22 15:49:24 +01:00
