Commit Graph

2027 Commits

Author SHA1 Message Date
meili-bors[bot]
42854c0bca Merge #5223
Some checks failed
Indexing bench (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of indexing (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of search for geo (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of search for songs (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of search for Wikipedia articles (push) / Run and upload benchmarks (push) Waiting to run
Test suite / Tests on ${{ matrix.os }} (macos-13) (push) Waiting to run
Test suite / Tests on ${{ matrix.os }} (windows-2022) (push) Failing after 12s
Test suite / Tests on ubuntu-20.04 (push) Failing after 11s
Test suite / Tests almost all features (push) Has been skipped
Test suite / Test disabled tokenization (push) Has been skipped
Test suite / Run tests in debug (push) Failing after 9s
Test suite / Run Clippy (push) Successful in 6m16s
Test suite / Run Rustfmt (push) Successful in 1m39s
Run the indexing fuzzer / Setup the action (push) Successful in 1h5m11s
5223: Limit batched tasks total size r=curquiza a=Kerollmops

Introduce a new engine parameter (env and config, too) to limit the maximum payload size processed by the engine in batches. You can [review the Discussion and usage on GitHub](https://github.com/orgs/meilisearch/discussions/801).

Co-authored-by: Clément Renault <clement@meilisearch.com>
2025-01-09 16:13:17 +00:00
Clément Renault
d0bdff7b7b Make the batched tasks size limit effectively work 2025-01-09 12:06:28 +01:00
Clément Renault
8650ee66c1 Introduce the new experimental-limit-batched-tasks-total-size argument 2025-01-09 12:06:28 +01:00
Clément Renault
00a03742ff Prefer using extend when merging bitmaps than unions (less allocations) 2025-01-09 10:42:38 +01:00
Louis Dureuil
d11e359244 When spilling on the next fid, no longer ignore children 2025-01-09 10:36:38 +01:00
Louis Dureuil
09d45439c7 Check valid_facet_value as part of a filter of the iterator 2025-01-09 10:36:38 +01:00
Louis Dureuil
5d92da0c73 No longer ignore the first child without parent 2025-01-09 10:36:38 +01:00
Louis Dureuil
677bb39e73 Modernize valid_lmdb_key 2025-01-09 10:36:38 +01:00
Louis Dureuil
85ea77de0b Switch to an iterative algorithm for find_changed_parents 2025-01-09 10:36:38 +01:00
Louis Dureuil
03317be0bd Update after review 2025-01-09 10:36:38 +01:00
Louis Dureuil
4aa7c8f7b1 Remove unused FacetFieldIdOperation 2025-01-09 10:36:37 +01:00
Louis Dureuil
ce57a342a3 center groups 2025-01-09 10:36:37 +01:00
Louis Dureuil
1cc6cd78e0 Fix uselessly deep stack trace 2025-01-09 10:36:37 +01:00
Louis Dureuil
c204afdc79 Update snapshot 2025-01-09 10:36:37 +01:00
Louis Dureuil
c14967eeac Use new incremental facet indexing and enable sanity checks in debug 2025-01-09 10:36:35 +01:00
Louis Dureuil
f38db86120 Add new incremental facet indexing 2025-01-09 10:24:36 +01:00
Louis Dureuil
50b155fa2d add valid_facet_value utility function 2025-01-09 10:24:36 +01:00
Louis Dureuil
a533c8e041 Add sanity checks for facet values 2025-01-09 10:24:36 +01:00
Tamo
908adee6fc Fix the addition of empty payload 2025-01-09 10:24:36 +01:00
Tamo
7b3353252f update the test to ensure it works when specifying the primary key or not: it doesn't work 2025-01-09 10:24:35 +01:00
Tamo
647a10bf18 stop skipping empty tasks when adding documents 2025-01-09 10:24:34 +01:00
Tamo
08c332980b add a test reproducing the bug 2025-01-09 10:12:12 +01:00
michascant
eecf4c53e7 updated changes 2025-01-08 15:10:09 -05:00
Clément Renault
cf4c3c287b Make rustfmt happy 2025-01-08 18:24:39 +01:00
Clément Renault
71e5605daa Make clippy happy 2025-01-08 18:24:39 +01:00
Clément Renault
0ee4671a91 Fix after upgrading candle 2025-01-08 15:59:56 +01:00
Clément Renault
68333424c6 Remove a useless script test 2025-01-08 15:59:43 +01:00
Clément Renault
d4529d8c83 Fix after upgrading sysinfo 2025-01-08 15:59:30 +01:00
Clément Renault
5e8144b0e1 Remove fuzzing feature 2025-01-08 15:59:03 +01:00
Clément Renault
3e3695445f Fix after upgrading thiserror 2025-01-08 15:58:32 +01:00
Clément Renault
091f989b72 Upgrade incompatible dependencies 2025-01-08 15:58:03 +01:00
Clément Renault
48a9ad4c17 Fix insta to 1.39 2025-01-08 15:18:08 +01:00
Clément Renault
b997039a91 Upgrade compatible dependencies 2025-01-08 13:52:14 +01:00
meili-bors[bot]
0e6b6bd130 Merge #4867
Some checks failed
Indexing bench (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of indexing (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of search for geo (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of search for songs (push) / Run and upload benchmarks (push) Waiting to run
Benchmarks of search for Wikipedia articles (push) / Run and upload benchmarks (push) Waiting to run
Test suite / Tests on ${{ matrix.os }} (macos-13) (push) Waiting to run
Test suite / Tests on ubuntu-20.04 (push) Failing after 12s
Test suite / Tests almost all features (push) Has been skipped
Test suite / Test disabled tokenization (push) Has been skipped
Test suite / Run tests in debug (push) Failing after 10s
Test suite / Tests on ${{ matrix.os }} (windows-2022) (push) Failing after 48s
Test suite / Run Clippy (push) Successful in 7m0s
Test suite / Run Rustfmt (push) Successful in 1m55s
Run the indexing fuzzer / Setup the action (push) Successful in 1h5m59s
4867: Autogenerate the openAPI spec r=irevoire a=irevoire

# Pull Request

## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/5073

## What does this PR do?
- Introduce utoipa and the auto-generation of the openAPI file
- Introduce the scalar swagger when the `swagger` feature flag is enabled.

Generating the openAPI file takes between 15 and 20ms at startup time on my computer. That could be an issue if we plan to stabilize the feature.

Co-authored-by: Tamo <tamo@meilisearch.com>
2025-01-08 09:45:50 +00:00
meili-bors[bot]
b1b0b0b67c Merge #5168
5168: Refactor indexer r=ManyTheFish a=dureuill

# Pull Request

Split the indexer mod into multiple submodules. 

This restores the ability of rustfmt to format the file 🎉

Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-01-08 09:12:49 +00:00
Mahmoud Rawas
27155f845c adding back a missing task wait. 2025-01-08 15:36:10 +11:00
Mahmoud Rawas
c6f14279d7 remove unused imports. 2025-01-08 15:11:34 +11:00
Tamo
99f5e09a79 fix the tests 2025-01-07 16:42:53 +01:00
Tamo
a8ef6f08e0 Update crates/meilisearch-types/src/settings.rs
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-01-07 16:31:39 +01:00
Tamo
ae5a04e85c apply review comments 2025-01-07 16:30:14 +01:00
Tamo
8ebfc9fa92 Update crates/meilisearch-types/src/settings.rs
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-01-07 16:30:14 +01:00
Tamo
21026f0ca8 move the swagger behind a feature flag 2025-01-07 16:30:14 +01:00
Tamo
e579554c84 fmt 2025-01-07 16:30:12 +01:00
Tamo
ff49250c1a remove useless doc 2025-01-07 16:29:09 +01:00
Tamo
8b95c6ae56 improve the description of all the settings route 2025-01-07 16:29:09 +01:00
Tamo
28162759a4 fix imports after rebase 2025-01-07 16:29:08 +01:00
Tamo
dd128656cb fix all the tests 2025-01-07 16:28:12 +01:00
Tamo
4456df5a46 fix some tests 2025-01-07 16:28:11 +01:00
Tamo
0b104b3efa fix the list indexes 2025-01-07 16:26:06 +01:00
Tamo
ac944f0960 review all the return type 2025-01-07 16:26:06 +01:00