48026aa75c
fix PR comments
2024-02-13 15:19:01 +01:00
55de96f74e
Update milli/src/update/facet/mod.rs
...
Co-authored-by: Clément Renault <clement@meilisearch.com >
2024-02-13 14:22:10 +01:00
39c83cb3d9
fix clippy
2024-02-12 09:12:54 +01:00
7877788510
fix logs
2024-02-12 09:12:54 +01:00
be1b054b05
Compute chunk size based on the input data size ant the number of indexing threads
2024-02-08 17:28:37 +01:00
e773dfa9ba
get rids of log in milli and add logs for the bucket sort
2024-02-08 15:04:05 +01:00
9f9ad4cc05
Fix Clippy warnings
2024-01-16 15:27:24 +01:00
d32eb11329
Move to the v0.20.0-alpha.9 of heed
2023-11-27 11:52:22 +01:00
0dbf1a16ff
Make clippy happy
2023-11-23 14:11:38 +01:00
462b4c0080
Fix the tests
2023-11-23 12:07:35 +01:00
0d4482625a
Make the changes to use heed v0.20-alpha.6
2023-11-23 11:43:58 +01:00
1bccf2079e
Correctly mark non-tests as non-tests
2023-11-06 11:03:56 +01:00
0fb6acefc3
Add snapshots for facets
2023-10-31 17:11:08 +01:00
b1d1355b69
remove tests on soft-deleted
2023-10-31 16:36:27 +01:00
03ddb4f310
use deladd in facet update tests
2023-10-31 16:36:27 +01:00
d8bf3f3fc2
Remove unused snapshots
2023-10-31 10:12:49 +01:00
dad78cbf8d
Bulk facet remove deletes keys from DB when value empty
2023-10-31 09:53:55 +01:00
290e773d23
remove more warnings and fix some tests
2023-10-30 11:41:22 +01:00
113527f466
Remove soft-deleted related methods from Index
2023-10-30 11:41:22 +01:00
2263dff02b
Stop using removed delete pipelines almost everywhere
2023-10-30 11:41:22 +01:00
d651b3ef01
Remove delete documents files
2023-10-30 11:41:20 +01:00
073f89db79
Fix facet tests
2023-10-30 11:40:20 +01:00
b26dc9aabe
Explanatory code comment
2023-10-30 11:39:31 +01:00
66abac9364
Use specialized KvReaderDelAdd type
...
Co-authored-by: Clément Renault <clement@meilisearch.com >
2023-10-30 11:39:31 +01:00
59f88c14b3
Simplify facet update after removing Index::faceted_documents_ids
2023-10-30 11:39:29 +01:00
14832cb324
Remove Index::faceted_documents_ids
2023-10-30 11:37:32 +01:00
04ec293024
Facet Incremental update
2023-10-30 11:37:30 +01:00
f67ff3a738
Facets Bulk update
2023-10-30 11:36:40 +01:00
0c47defeee
Work on fid docid facet values rewrite
2023-10-30 11:29:06 +01:00
d772073dfa
use a bufreader everytime there is a grenad<file>
2023-10-10 15:00:30 +02:00
35758db9ec
Truncate the the normalized long facets used in search for facet value
2023-08-08 16:38:30 +02:00
df528b41d8
Normalize for the search the facets values
2023-07-20 17:57:07 +02:00
e9a3029c30
Use the right field id to write the string facet values FST
2023-06-28 15:01:51 +02:00
f36de2115f
Make clippy happy
2023-06-28 15:01:50 +02:00
15a4c05379
Store the facet string values in multiple FSTs
2023-06-28 14:58:41 +02:00
c4a40e7110
Use the writemap flag to reduce the memory usage
2023-05-15 10:15:33 +02:00
cfd1b2cc97
Fix the clippy warnings
2023-04-25 16:40:32 +02:00
fbec48f56e
Merge remote-tracking branch 'milli/main' into bring-v1-changes
2023-02-06 16:48:10 +01:00
20f05efb3c
clippy: needless_lifetimes
2023-01-31 11:12:59 +01:00
3296cf7ae6
clippy: remove needless lifetimes
2023-01-31 09:32:40 +01:00
1b78231e18
Make clippy happy
2023-01-17 18:25:54 +01:00
ad9937c755
Fix tests after adding DeletionStrategy
2022-12-19 10:07:17 +01:00
cda4ba2bb6
Add document import tests
2022-12-05 12:02:49 +01:00
f2cf981641
Add more tests and allow disabling of soft-deletion outside of tests
...
Also allow disabling soft-deletion in the IndexDocumentsConfig
2022-12-05 10:51:01 +01:00
9dd4b33a9a
Fix bulk facet indexing bug
2022-11-30 14:27:36 +01:00
0caadedd3b
Make clippy happy
2022-11-17 12:17:53 +01:00
d95d02cb8a
Fix Facet Indexing bugs
...
1. Handle keys with variable length correctly
This fixes https://github.com/meilisearch/meilisearch/issues/3042 and
is easily reproducible with the updated fuzz tests, which now generate
keys with variable lengths.
2. Prevent adding facets to the database if their encoded value does
not satisfy `valid_lmdb_key`.
This fixes an indexing failure when a document had a filterable
attribute containing a value whose length is higher than ~500 bytes.
2022-11-17 11:29:42 +01:00
abf1cf9cd5
Fix clippy errors
2022-11-04 09:27:46 +09:00
d55f0e2e53
Execute cargo fmt
2022-10-28 23:42:23 +09:00
d53a80b408
Fix clippy error
2022-10-28 23:41:35 +09:00
