e9bf4c43a4
Merge #4649
...
4649: Don't store the vectors in the documents database r=dureuill a=irevoire
# Pull Request
## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/4607
## What does this PR do?
- Ensure that anything falling under `_vectors` is NOT searchable, filterable or sortable
- [x] per embedder, add a roaring bitmap of documents that provide "userProvided" embeddings
- [x] in the indexing process in extract_vector_points, set the bit corresponding to the document depending on the "userProvided" subfield in the _vectors field.
- [x] in the document DB in typed chunks, when writing the _vectors field, remove all keys corresponding to an embedder
Co-authored-by: Tamo <tamo@meilisearch.com >
Co-authored-by: Louis Dureuil <louis@meilisearch.com >
2024-06-17 12:32:03 +00:00
0a8f50695e
Fixes for Rust v1.79
2024-06-13 17:47:44 +02:00
e0eff08095
Merge #4685
...
4685: Fix ci tests r=dureuill a=ManyTheFish
# Pull Request
Make the all following CI succeed:
https://github.com/meilisearch/meilisearch/actions/runs/9477183091
## Related issue
Fixes #4629
## What does this PR do?
- Change the test behavior for `swedish-recomposition` feature flag
- Remove the `-v` parameter from grep
Co-authored-by: ManyTheFish <many@meilisearch.com >
Co-authored-by: Many the fish <many@meilisearch.com >
2024-06-12 07:58:33 +00:00
57d066595b
fix Tests almost all features
2024-06-06 17:24:50 +02:00
75b2e02cd2
Log more stuff around filtering
2024-06-06 11:00:07 -04:00
52d0d35b39
Revert "Reduce the universe while exploring the facet tree" because it's slower this way
...
This reverts commit 14026115f21409535772ede0ee4273f37848dd61.
2024-06-06 09:17:51 -04:00
5432776132
Reduce the universe while exploring the facet tree
2024-06-06 09:17:51 -04:00
66470b27e6
Use the MultiOps trait for IN operations
2024-06-06 09:17:51 -04:00
0a9bd398c7
Improve the NOT operator to use the universe when possible
2024-06-06 09:17:51 -04:00
7967e93c16
Skip evaluating when a universe is empty, nothing can be found
2024-06-06 09:17:51 -04:00
a6f3a01c6a
Expose the universe to do efficient intersections on deserialization
2024-06-06 09:17:51 -04:00
531e3d7d6a
MultiOps trait for OR operations
2024-06-06 09:17:50 -04:00
5d50850e12
always push the user defined vectors in arroy
2024-06-06 11:39:29 +02:00
fc584f1db3
Merge #4666
...
4666: Add a score threshold search parameter r=ManyTheFish a=dureuill
# Pull Request
## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/4609
## What does this PR do?
- See [usage](https://meilisearch.notion.site/Filter-by-score-usage-224a183ce7b24ca99b6a9a8da755668a?pvs=25#95b76ded400342ba9ab3d67c734836f0 ) and [the known limitation](https://meilisearch.notion.site/Filter-by-score-usage-224a183ce7b24ca99b6a9a8da755668a?pvs=25#e4e32195bf0e4195b5daecdbb7a97a17 )
Co-authored-by: Louis Dureuil <louis@meilisearch.com >
2024-06-03 08:42:44 +00:00
2b6db6541e
Changes after review
2024-06-03 10:30:00 +02:00
d6bd88ce4f
Merge #4667
...
4667: Frequency matching strategy r=Kerollmops a=ManyTheFish
# Pull Request
## Related issue
Fixes #3773
## What does this PR do?
- add test for matching strategy
- implement frequency matching strategy
See the [PRD for more details](https://www.notion.so/meilisearch/Frequency-Matching-Strategy-0f3ba08833a442a39590a53a1505ab00 ).
[Public API](https://www.notion.so/meilisearch/frequency-matching-strategy-89868fb7fc584026bc56e378eb854a7f ).
Co-authored-by: ManyTheFish <many@meilisearch.com >
2024-05-30 14:53:31 +00:00
3f1a510069
Add tests and fix matching strategy
2024-05-30 12:02:42 +02:00
4f03b0cf5b
Add ranking score threshold to similar
2024-05-30 11:20:50 +02:00
aac1d769a7
Add ranking_score_threshold to milli
2024-05-29 14:17:09 +02:00
abdc4afcca
Implement Frequency matching strategy
2024-05-29 13:59:08 +02:00
ca6cc4654b
Add similar route
2024-05-28 15:28:19 +02:00
d35278320e
Add support functions for accessing arroy writers and readers
2024-05-28 15:27:43 +02:00
02b3d82c60
filtered_universe accepts index and txn instead of SearchContext
2024-05-28 15:22:12 +02:00
c78a2fa4f5
rename method and variable around the attributes to search on feature
2024-05-15 18:04:42 +02:00
5542f1d9f1
get back to what we were doingb efore in the DB cache and with the restricted field id
2024-05-15 18:00:39 +02:00
7ec4e2a3fb
apply all style review comments
2024-05-15 15:02:26 +02:00
9fffb8e83d
make clippy happy
2024-05-14 17:36:32 +02:00
caa6a7149a
make the attribute ranking rule use the weights and fix the tests
2024-05-14 17:36:32 +02:00
685f452fb2
Fix the indexing of the searchable
2024-05-14 17:00:02 +02:00
c22460045c
Stops returning an option in the internal searchable fields
2024-05-14 17:00:02 +02:00
4d5971f343
Merge #4621
...
4621: Bring back changes from v1.8.0 into main r=curquiza a=curquiza
Co-authored-by: ManyTheFish <many@meilisearch.com >
Co-authored-by: Tamo <tamo@meilisearch.com >
Co-authored-by: meili-bors[bot] <89034592+meili-bors[bot]@users.noreply.github.com>
Co-authored-by: Clément Renault <clement@meilisearch.com >
2024-05-06 13:46:39 +00:00
ab43a8a949
chore: fix some typos in comments
...
Signed-off-by: writegr <wellweek@outlook.com >
2024-04-18 14:12:52 +08:00
c923adf222
Fix facet distribution for alpha on facet numbers
2024-04-17 16:31:16 +02:00
cf864a1c2e
chore: fix some typos in comments
...
Signed-off-by: yudrywet <yudeyao@yeah.net >
2024-04-14 20:11:34 +08:00
1ff2a2d6fb
Add semanticHitCount
2024-04-04 16:04:06 +02:00
6ebb6b55a6
Lazily embed, don't fail hybrid search on embedding failure
2024-04-04 15:58:17 +02:00
928e6e4c05
Breaking change: remove vector for score details
2024-04-04 15:57:29 +02:00
877f4b1045
Support negative phrases
2024-03-28 15:51:43 +01:00
69f8b2730d
Fix the tests
2024-03-28 10:47:04 +01:00
34262c7a0d
Add analytics for the negative operator
2024-03-26 18:01:27 +01:00
1da9e0f246
Better support space around the negative operator (-)
2024-03-26 17:47:13 +01:00
e4a3e603b3
Expose a first working version of the negative keyword
2024-03-26 17:47:13 +01:00
6079141ea6
snapshot the scores side by side with the score details
2024-03-19 18:30:14 +01:00
2c3af8e513
query the detailed score detail in the test
2024-03-19 18:09:02 +01:00
098ab594eb
A score of 0.0 is now lesser than a sort result
...
handles the niche case 🐩 in the hybrid search where:
1. a sort ranking rule is the first rule.
2. the keyword search is skipped at the first rule.
3. the semantic search is not skipped at the first rule.
Previously, we would have the skipped search winning, whereas we want the non skipped one winning.
2024-03-19 17:32:32 +01:00
7b9e0d2944
forward the degraded parameter to the hybrid search
2024-03-19 15:11:21 +01:00
bfec9468d4
Update milli/src/search/mod.rs
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com >
2024-03-19 14:49:15 +01:00
b8cda6c300
fix the search cutoff and add a test
2024-03-19 10:35:47 +01:00
4a467739cd
implements a first version of the cutoff without settings
2024-03-19 10:28:21 +01:00
5c95b5c933
chore: remove repetitive words
...
Signed-off-by: shuangcui <fliter@qq.com >
2024-03-14 21:28:55 +08:00
