3c304c89d4
Make sure that we generate the faceted database when required
2021-06-02 16:24:58 +02:00
b0c0490e85
Make sure that we can add a Asc/Desc field without it being filterable
2021-06-02 16:24:58 +02:00
6476827d3a
Fix the indexer to be sure that distinct and Asc/Desc are also faceted
2021-06-02 16:24:58 +02:00
2a3f9b32ff
Rename the faceted fields into filterable fields
2021-06-02 16:24:57 +02:00
ab2cf69e8d
Update milli/src/update/delete_documents.rs
...
Co-authored-by: Clément Renault <clement@meilisearch.com >
2021-06-01 17:04:10 +02:00
8e6d1ff0dc
Update milli/src/update/index_documents/store.rs
...
Co-authored-by: Clément Renault <clement@meilisearch.com >
2021-06-01 17:04:02 +02:00
4ddf008be2
add field id word count database
2021-05-31 16:27:28 +02:00
1c0a5cd136
Resolve code modification suggestions
2021-05-31 15:22:50 +02:00
3a4a150ef0
Fix the tests and remaining warnings
2021-05-25 11:31:06 +02:00
bd7b285bae
Split the update side to use the number and the strings facet databases
2021-05-25 11:30:00 +02:00
837c1041c7
Clear and delete the documents from the facet database
2021-05-25 11:28:36 +02:00
f8d0f5265f
fix(update): fields distribution after documents merge
2021-05-04 22:12:20 +03:00
d81c0e8bba
feat(update): disable autogenerate_docids by default
2021-04-30 21:41:34 +03:00
e8e32e0ba1
make document addition number visible
2021-04-29 20:05:07 +02:00
e65bad16cc
Compute the words prefixes at the end of an update
2021-04-27 14:39:52 +02:00
0ad9499b93
Fix an indexing bug in the words level positions
2021-04-27 14:35:43 +02:00
7aa5753ed2
Make the attribute positions range bounds to be fixed
2021-04-27 14:35:43 +02:00
89ee2cf576
Introduce the TreeLevel struct
2021-04-27 14:25:35 +02:00
bd1a371c62
Compute the WordsLevelPositions only once
2021-04-27 14:25:34 +02:00
8bd4f5d93e
Compute the biggest values of the words_level_positions_docids
2021-04-27 14:25:34 +02:00
f713828406
Implement the clear and delete documents for the word-level-positions database
2021-04-27 14:25:34 +02:00
3069bf4f4a
Fix and improve the words-level-positions computation
2021-04-27 14:25:34 +02:00
3a25137ee4
Expose and use the WordsLevelPositions update
2021-04-27 14:25:34 +02:00
c765f277a3
Introduce the WordsLevelPositions update
2021-04-27 14:25:34 +02:00
9242f2f1d4
Store the first word positions levels
2021-04-27 14:25:34 +02:00
b0a417f342
Introduce the word_level_position_docids Index database
2021-04-27 14:25:34 +02:00
c9b2d3ae1a
Warn instead of returning an error when a conversion fails
2021-04-20 10:23:31 +02:00
51767725b2
Simplify integer and float functions trait bounds
2021-04-20 10:23:31 +02:00
33860bc3b7
test(update, settings): set & reset synonyms
...
fixes after review
more fixes after review
2021-04-18 11:24:17 +03:00
e39aabbfe6
feat(search, update): synonyms
2021-04-18 11:24:17 +03:00
45c45e11dd
implement distinct attribute
...
distinct can return error
facet distinct on numbers
return distinct error
review fixes
make get_facet_value more generic
fixes
2021-04-15 16:25:55 +02:00
dcb00b2e54
test a new implementation of the stop_words
2021-04-12 18:35:33 +02:00
84c1dda39d
test(http): setting enum serialize/deserialize
2021-04-08 17:03:40 +03:00
dc636d190d
refactor(http, update): introduce setting enum
2021-04-08 17:03:40 +03:00
2658c5c545
feat(index): update fields distribution in clear & delete operations
...
fixes after review
bump the version of the tokenizer
implement a first version of the stop_words
The front must provide a BTreeSet containing the stop words
The stop_words are set at None if an empty Set is provided
add the stop-words in the http-ui interface
Use maplit in the test
and remove all the useless drop(rtxn) at the end of all tests
Integrate the stop_words in the querytree
remove the stop_words from the querytree except if it was a prefix or a typo
more fixes after review
2021-04-01 19:12:35 +03:00
27c7ab6e00
feat(index): store fields distribution in index
2021-04-01 18:35:19 +03:00
a2f46029c7
implement a first version of the stop_words
...
The front must provide a BTreeSet containing the stop words
The stop_words are set at None if an empty Set is provided
add the stop-words in the http-ui interface
Use maplit in the test
and remove all the useless drop(rtxn) at the end of all tests
2021-04-01 13:57:55 +02:00
9205b640a4
feat(index): introduce fields_ids_distribution
2021-03-31 18:44:47 +03:00
615fe095e1
update index updated at on index writes
2021-03-15 14:05:47 +01:00
f51eb46c69
Use the RoaringBitmapLenCodec to retrieve the count of documents
2021-03-09 10:25:39 +01:00
e5bb96bc3b
Fix the searchable settings test
2021-03-06 12:48:41 +01:00
07784c8990
Tune the words prefixes threshold to compute for 1/1000 instead
2021-03-03 15:51:28 +01:00
f376c6a728
Make sure we retrieve the docid word positions
2021-03-03 15:45:03 +01:00
246286f0eb
take hard separator into account
2021-03-03 15:45:03 +01:00
e08b6b3ec7
add primary key to fields_id_map when not present
2021-03-01 16:10:16 +01:00
c318373b88
Expose the WordsPrefixes update on the UpdateBuilder
2021-02-21 12:15:35 +01:00
a4a48be923
Run the words prefixes update inside of the indexing documents update
2021-02-17 11:22:26 +01:00
616ed8f73c
Clean up the word prefix pair proximities when deleting documents
2021-02-17 11:22:26 +01:00
ea37fd821d
Clean up the words prefixes when deleting documents and words
2021-02-17 11:22:25 +01:00
62eee9c69e
Introduce the sorter_into_lmdb_database helper function
2021-02-17 11:12:39 +01:00
