626be0ef28
Small typo fix
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com >
2025-07-17 17:27:00 +02:00
fe15e11c9d
Introduce a new CLI and env var to use the old document indexer when
...
importing dumps
2025-07-17 17:12:51 +02:00
2b2e6c0b3a
Settings changes
2025-07-02 00:05:13 +02:00
5716ab70f3
EmbeddingConfigs -> RuntimeEmbedders
2025-07-02 00:05:11 +02:00
4352a924d7
Remove useless filters parameter
2025-06-10 14:05:02 +02:00
bbe802c656
Remove the write txn method from the index scheduler
2025-06-10 14:03:05 +02:00
b32e30ad27
Make the chat setting db name a const
2025-06-10 14:02:43 +02:00
e654eddf56
Improve the chat workspace REST endpoints
2025-06-10 10:21:34 +02:00
02cbcea3db
Better chat completions settings management
2025-06-03 15:31:28 +02:00
0f7f5fa104
Introduce listing/getting/deleting/updating chat workspace settings
2025-06-03 15:31:28 +02:00
564f85280c
Make clippy happy
2025-06-03 15:31:03 +02:00
7d8415448c
Commit when putting stuff in LMDB
2025-06-03 15:31:03 +02:00
a52b513023
Expose new chat settings routes
2025-06-03 15:31:02 +02:00
82fa70da83
Support overwriten prompts of the search query
2025-06-03 15:30:48 +02:00
cc2011a27f
Merge pull request #5565 from meilisearch/fix-0-batched-task
...
Fix 0 batched task
2025-05-15 12:41:48 +00:00
8608d10fa2
Don't process any tasks if the max number of batched tasks is set to 0
2025-05-14 17:09:10 +02:00
83e71cd7b9
Add an experimental cli flag to disable snapshot compaction
2025-05-14 15:59:35 +02:00
e1aa534389
Wait 10 seconds in case of irrecoverable error
2025-04-24 16:06:19 +02:00
fd0623c085
Fix typo in function to get size until task queue stops
2025-04-17 10:48:56 +02:00
eeb33b913c
Corrected metric for task queue total size
2025-04-17 10:46:26 +02:00
3d93efc6aa
Added metric to check task queue size until stop
2025-04-17 10:46:25 +02:00
b025f1bcf1
Merge branch 'main' into release-v1.14.0-tmp
2025-04-14 12:35:47 +02:00
796a325972
Fix typos
...
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-04-03 15:53:42 +02:00
1db550ec7f
make meilisearch accept cancelation tasks even when the disk is full
2025-04-03 15:47:56 +02:00
4d90e3d2ec
Make Cargo and Clippy happy
2025-04-01 11:26:34 +02:00
e2d372823a
Disable the cache by default and make it experimental
2025-03-13 17:22:51 +01:00
5e6abcf50c
Prefer using WithoutTls for the auth env
2025-03-13 11:29:00 +01:00
55ca2c4481
Avoid opening the Auth environment multiple times
2025-03-13 11:07:49 +01:00
1d499ed9b2
Use the new arroy upgrade method to move from 0.4 to 0.5
2025-03-13 11:07:44 +01:00
3bc62f0549
WIP: Still need to introduce a Env::copy_to_path method
2025-03-13 11:07:39 +01:00
628119e31e
fix the dumpless upgrade potential corruption when upgrading from the v1.12
2025-02-05 18:08:50 +01:00
4918b9ffb6
Network stored in DB
2025-02-05 15:03:15 +01:00
b9e9fc376a
add the version in the index-scheduler
2025-01-23 16:51:22 +01:00
e41ebd3047
expose the number of database in the index-scheduler and rewrite the lib.rs to use the value provided in the options instead of a magic number
2025-01-23 16:51:21 +01:00
3ef7a478cd
move the version check to the task queue
2025-01-23 16:48:32 +01:00
d3654906bf
Add the new tasks with most of the job done
2025-01-23 16:48:32 +01:00
42854c0bca
Merge #5223
...
Indexing bench (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of indexing (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of search for geo (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of search for songs (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of search for Wikipedia articles (push) / Run and upload benchmarks (push) Waiting to run
Test suite / Tests on ${{ matrix.os }} (macos-13) (push) Waiting to run
Test suite / Tests on ${{ matrix.os }} (windows-2022) (push) Failing after 12s
Test suite / Tests on ubuntu-20.04 (push) Failing after 11s
Test suite / Tests almost all features (push) Has been skipped
Test suite / Test disabled tokenization (push) Has been skipped
Test suite / Run tests in debug (push) Failing after 9s
Test suite / Run Clippy (push) Successful in 6m16s
Test suite / Run Rustfmt (push) Successful in 1m39s
Run the indexing fuzzer / Setup the action (push) Successful in 1h5m11s
5223: Limit batched tasks total size r=curquiza a=Kerollmops
Introduce a new engine parameter (env and config, too) to limit the maximum payload size processed by the engine in batches. You can [review the Discussion and usage on GitHub](https://github.com/orgs/meilisearch/discussions/801 ).
Co-authored-by: Clément Renault <clement@meilisearch.com >
2025-01-09 16:13:17 +00:00
d0bdff7b7b
Make the batched tasks size limit effectively work
2025-01-09 12:06:28 +01:00
71e5605daa
Make clippy happy
2025-01-08 18:24:39 +01:00
cb82b0798a
Split the index-scheduler in ~500 loc modules
2025-01-06 14:08:26 +01:00
4eae92f411
fix list indexes
2024-12-26 18:48:25 +01:00
d12364c1e0
fix the tests
2024-12-11 18:30:48 +01:00
ab75f53efd
update all snapshots
2024-12-11 16:25:02 +01:00
df9b68f8ed
inital implementation of the progress
2024-12-11 16:25:01 +01:00
b75f1f4c17
fix tests
...
# Conflicts:
# crates/index-scheduler/src/batch.rs
# crates/index-scheduler/src/snapshots/lib.rs/fail_in_process_batch_for_document_deletion/after_removing_the_documents.snap
# crates/index-scheduler/src/snapshots/lib.rs/test_document_addition_with_bad_primary_key/fifth_task_succeeds.snap
# crates/index-scheduler/src/snapshots/lib.rs/test_document_addition_with_bad_primary_key/fourth_task_fails.snap
# crates/index-scheduler/src/snapshots/lib.rs/test_document_addition_with_multiple_primary_key/second_task_fails.snap
# crates/index-scheduler/src/snapshots/lib.rs/test_document_addition_with_multiple_primary_key/third_task_fails.snap
# crates/index-scheduler/src/snapshots/lib.rs/test_document_addition_with_multiple_primary_key_batch_wrong_key/second_and_third_tasks_fails.snap
# crates/index-scheduler/src/snapshots/lib.rs/test_document_addition_with_set_and_null_primary_key_inference_works/all_other_tasks_succeeds.snap
# crates/index-scheduler/src/snapshots/lib.rs/test_document_addition_with_set_and_null_primary_key_inference_works/second_task_fails.snap
# crates/index-scheduler/src/snapshots/lib.rs/test_document_addition_with_set_and_null_primary_key_inference_works/third_task_succeeds.snap
# Conflicts:
# crates/index-scheduler/src/batch.rs
# crates/meilisearch/src/search/mod.rs
# crates/meilisearch/tests/vector/mod.rs
# Conflicts:
# crates/index-scheduler/src/batch.rs
2024-12-06 02:03:02 +08:00
95ed079761
attach index name in errors
...
# Conflicts:
# crates/index-scheduler/src/batch.rs
# Conflicts:
# crates/index-scheduler/src/batch.rs
# crates/meilisearch/src/search/mod.rs
2024-12-06 01:12:13 +08:00
26be5e0733
Merge #5123
...
5123: Fix batch details r=dureuill a=irevoire
# Pull Request
## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/5079
Fixes https://github.com/meilisearch/meilisearch/issues/5112
## What does this PR do?
- Make the processing tasks actually processing in the stats of the batch instead of enqueued
- Stop counting one extra task for all non-prioritized batches in the stats
- Add a test
Co-authored-by: Tamo <tamo@meilisearch.com >
2024-12-05 15:21:55 +00:00
cb0c3a5aad
stop adding one enqueued tasks to all unprioritized batches
2024-12-04 15:48:28 +01:00
cbcf6c9ba3
make the processing tasks as processing in a batch
2024-12-04 14:48:48 +01:00
bf742d81cf
add a test
2024-12-04 14:47:02 +01:00
