snowykami/meilisearch
1
0
Fork 0
mirror of https://github.com/meilisearch/meilisearch.git synced 2025-10-31 07:56:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,900 Commits 257 Branches 544 Tags
97e17f52a1d1a0b66ae0f304b3f5214ff5d9acc6
Commit Graph

576 Commits

Author SHA1 Message Date
Kerollmops
97e17f52a1 Add more logs to see calls to the embedders 2025-01-30 16:36:12 +01:00
meili-bors[bot]
8ed39f5de0 Merge #5300 
5300: Improve unexpected panic message r=irevoire a=irevoire

# Pull Request

## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/5273

## What does this PR do?
- When an unexpected panic happens in the index-scheduler we catch it and rebuild an error message from the join_error
- Same when the upgrade index-scheduler fails


Co-authored-by: Tamo <tamo@meilisearch.com>
 2025-01-30 09:23:17 +00:00
Tamo
bdd3005d10 Log the progress when a batch fails 2025-01-29 16:36:23 +01:00
Kerollmops
cb1b7513af Log the memory metrics only once 2025-01-29 15:21:52 +01:00
Clément Renault
a9d0f4a002 Improve english comments 
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
 2025-01-29 15:16:40 +01:00
Kerollmops
db032079d8 Show indexation allocated memory 2025-01-29 14:21:02 +01:00
Clément Renault
a00796c46a Improve the naming in the log message 2025-01-29 14:21:02 +01:00
Kerollmops
6112bd8caa Display the channel congestion 2025-01-29 14:21:02 +01:00
Kerollmops
cec88cfc29 Measure the bbqueue congestion 2025-01-29 14:21:02 +01:00
Tamo
8439aeb7cf improve error message in case of unexpected panic while processing tasks 2025-01-29 11:51:06 +01:00
Tamo
1beda3b9af fix another flaky test 2025-01-28 16:53:50 +01:00
Tamo
8676e94f5c fix the flaky tests 2025-01-28 16:53:50 +01:00
Tamo
ef47a0d820 apply review comment 2025-01-28 16:53:50 +01:00
Tamo
e0f0da57e2 make sure the batches we snapshots actually all contains an enqueued_at 2025-01-28 16:53:50 +01:00
Tamo
485e3127c7 use the remove_n_tasks_datetime_earlier_than function when updating batches 2025-01-28 16:53:50 +01:00
Tamo
58f90b70c7 store the enqueued at to eases the batch deletion 2025-01-28 16:53:50 +01:00
Tamo
508db9020d update the snapshots 2025-01-28 16:53:50 +01:00
Kerollmops
6ff37c6fc4 Fix the insta snapshots 2025-01-28 16:53:50 +01:00
Kerollmops
f21ae1f5d1 Remove the batch id from the date time databases 2025-01-28 16:53:50 +01:00
manojks1999
528d9d6d8b Removed CouldNotUpgrade from error file 2025-01-26 21:04:57 +05:30
Louis Dureuil
50280bf02b Support offline upgrade up to v1.12.7 2025-01-24 12:25:33 +01:00
Clément Renault
9b579069df Comment the max grant of the bbqueue 
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
 2025-01-24 12:18:32 +01:00
Louis Dureuil
f5a4a1c8b2 Give more RAM to bbqueue. 
- bbqueue buffers used to have (5% * 2%) / num_threads
- they now have 5% / num_threads
 2025-01-24 12:18:32 +01:00
Kerollmops
5ab4cdb1f3 Reduce the maximum grant possible we can store in the BBQueue 2025-01-24 12:18:32 +01:00
Louis Dureuil
73d8a4eace Remove db.snapshot 2025-01-23 17:21:42 +01:00
Louis Dureuil
c1e5897076 Do not assume v1.12 when there is no index-scheduler version 2025-01-23 17:16:53 +01:00
Louis Dureuil
718a98fbbf remove : char from filenames 2025-01-23 17:08:35 +01:00
Louis Dureuil
86bf231d29 Change to meilitool after rebase 2025-01-23 16:59:32 +01:00
Louis Dureuil
182c3f4b80 Write assumed version to the index-scheduler version db when it is missing 2025-01-23 16:51:25 +01:00
Tamo
c1eba66443 introduce a corruption in the v1.12 data.ms field distribution 2025-01-23 16:51:24 +01:00
Tamo
7197ced673 fix the bad index version on opening 2025-01-23 16:51:24 +01:00
Tamo
4f21ee6c66 update the data.ms snapshot 2025-01-23 16:51:24 +01:00
Tamo
787472453d write the version of the index while upgrading it 2025-01-23 16:51:24 +01:00
Tamo
8f65f35de9 rewrite part of the index-scheduler upgrade test 2025-01-23 16:51:23 +01:00
Tamo
c27c923439 introduce a trait to upgrade the indexes 2025-01-23 16:51:23 +01:00
Tamo
fd5649091d add the upgradeTo field in the details 2025-01-23 16:51:23 +01:00
Tamo
9a57736773 fix the early exit when rewriting a batch 2025-01-23 16:51:23 +01:00
Tamo
7740997ea8 reintroduce the unrecoverable error and use it where its supposed to be used 2025-01-23 16:51:22 +01:00
Tamo
7eb23f73ba add the version to the index-scheduler snapshots + fix a bug when opening an index scheduler for the first time 2025-01-23 16:51:22 +01:00
Tamo
b9e9fc376a add the version in the index-scheduler 2025-01-23 16:51:22 +01:00
Tamo
27bf2f1298 remove the empty progress made for the upgrade database 2025-01-23 16:51:22 +01:00
Tamo
d4d82fbd0c commit the index wtxn before the index-scheduler wtxn 2025-01-23 16:51:21 +01:00
Tamo
eda09a54da improve the index-scheduler tests 2025-01-23 16:51:21 +01:00
Tamo
b132d70413 fix the details in all cases 2025-01-23 16:51:21 +01:00
Tamo
e41ebd3047 expose the number of database in the index-scheduler and rewrite the lib.rs to use the value provided in the options instead of a magic number 2025-01-23 16:51:21 +01:00
Tamo
705d31e8bd apply all the comments changes 2025-01-23 16:51:21 +01:00
Tamo
7d95950ce6 fix warning 2025-01-23 16:51:21 +01:00
Tamo
c6b4c21c23 update the snapshots after the rebase 2025-01-23 16:51:20 +01:00
Tamo
bf96fdb858 update the cli url 2025-01-23 16:51:20 +01:00
Tamo
41eeffd88d fmt 2025-01-23 16:51:20 +01:00