Commit Graph

67 Commits

Author SHA1 Message Date
87a56d2bc9 Fix settings bug
replace ids with str in settings

This allows for better maintainability of the settings code, since
updating the searchable attributes is now straightforward.

criterion use string

fix reindexing fieldid remaping

add tests for primary_key compute

fix tests

fix http-ui

fixup! add tests for primary_key compute

code improvements settings

update deps

fixup! code improvements settings

fixup! refactor settings updates and fix bug

fixup! Fix settings bug

fixup! Fix settings bug

fixup! Fix settings bug

Update src/update/index_documents/transform.rs

Co-authored-by: Clément Renault <clement@meilisearch.com>

fixup! Fix settings bug
2021-01-26 13:53:08 +01:00
4f7f7538f7 highlight with new tokenizer 2021-01-11 21:59:37 +01:00
1ae761311e integrate with meilisearch tokenizer 2021-01-07 16:14:27 +01:00
3cdf14d4c5 Introduce the field-id-docid-facet-values database 2020-12-04 12:03:20 +01:00
61b383f422 Introduce the criteria update setting 2020-12-04 12:02:22 +01:00
ecc8bc8910 Introduce the FieldId u8 alias type 2020-12-02 11:19:45 +01:00
96f64c629e Move the UpdateStore out of the update module 2020-12-01 14:51:05 +01:00
58a1f9081c Allow users to abort pending updates, one by one or all at once 2020-12-01 14:51:05 +01:00
d0240bd9d0 Done a big clippy pass 2020-12-01 14:45:19 +01:00
ba4ba685f9 Make the facet levels maps to previous level groups and don't split them 2020-11-28 12:43:43 +01:00
54d5cec582 Transform numbers into strings when faceted and necessary 2020-11-23 16:43:56 +01:00
fc686aaca7 Use the De Morgan law to simplify the NOT operation 2020-11-23 16:43:56 +01:00
c52d09d5b1 Support a basic version of the string facet query system 2020-11-23 16:43:55 +01:00
59ca4b9fe4 Introduce a little bit of debug when deleting documents 2020-11-23 16:43:53 +01:00
0694cc4916 Drastically speed up documents deletion updates 2020-11-23 16:43:53 +01:00
38c76754ef Make the facet level search system generic on f64 and i64 2020-11-23 16:43:52 +01:00
67d4a1b3fc Introduce a new update for the facet levels 2020-11-23 16:43:51 +01:00
9ec95679e1 Introduce a function to retrieve the facet level range docids 2020-11-23 16:43:50 +01:00
fd8360deb1 Update the facet indexing facet test 2020-11-23 16:43:50 +01:00
9b7e516a56 Fix the indexing process going back in time 2020-11-23 16:43:49 +01:00
27f3ef5f7a Use the new ExternalDocumentsIds struct in the engine 2020-11-22 19:27:34 +01:00
eded5558b2 Rename the users ids documents ids into external documents ids 2020-11-22 17:17:47 +01:00
f06355b0bb Display the time it takes to merge user documents ids 2020-11-22 11:28:35 +01:00
e76558b0cc Change the settings update system to reindex only one time 2020-11-14 11:17:49 +01:00
f9cc12ae0f Do not try to parse empty faceted strings 2020-11-13 18:35:47 +01:00
a18d9a1f87 Parse and store the faceted fields 2020-11-13 16:13:51 +01:00
4e5e55c21a Simplify the merge functions 2020-11-13 14:50:30 +01:00
466fb601d6 Faceted fields settings must specify the facet type 2020-11-13 11:46:48 +01:00
ebe7087bff Introduce the faceted fields setting 2020-11-11 17:08:18 +01:00
92ec908303 Introduce the facet field id values engine database 2020-11-11 16:06:33 +01:00
ea43080548 Make the indexing process send the new progress step events 2020-11-11 13:13:08 +01:00
e78b96a657 Introduce a more detailed progress status enum 2020-11-11 12:31:59 +01:00
535f8088d7 Write the words pairs proximities directly into LMDB to speedup indexing 2020-11-11 11:25:31 +01:00
45ae086974 Make sure pending updates are process when restarting the UpdateStore 2020-11-09 17:33:07 +01:00
4fb138c42e Make sure we index all kind of JSON types 2020-11-06 16:35:07 +01:00
a31db33e93 Introduce an optimization when the searchable attributes are ordered 2020-11-03 19:59:09 +01:00
63f65bac3e Ignore the long running UpdateStore test 2020-11-03 19:12:00 +01:00
a20c871ece Add more tests to the Settings searchable attributes operation 2020-11-03 18:58:19 +01:00
649fb6e401 Make sure that the indexing Store only index searchable fields 2020-11-03 18:58:19 +01:00
e48630da72 Introduce the searchable parameter settings to the Settings update 2020-11-03 18:58:19 +01:00
7e120fc441 Allow library users to specify the rayon ThreadPool for UpdateBuilder 2020-11-02 19:11:22 +01:00
995d72b8c1 Introduce the Settings update operation 2020-11-02 15:31:20 +01:00
3abfe8aa22 Validate documents ids before accepting them 2020-11-01 20:55:21 +01:00
0ccf4cf785 Simplify the IndexDocuments builder creation from the UpdateBuilder 2020-11-01 17:31:20 +01:00
600aa223c2 Fix a bug where generated docids were not saved when indexing JSON docs 2020-11-01 12:19:07 +01:00
f0e63025b0 Update the Transform struct to support JSON stream updates 2020-11-01 12:19:06 +01:00
6d52c5b2f0 Introduce a parameter to disable the engine to autogenerate docids 2020-10-31 21:46:55 +01:00
21b4d60101 Add replace/update csv/json from the HTTP server 2020-10-31 20:52:49 +01:00
a4f8be7811 Support numbers and boolean when indexing JSON 2020-10-31 20:52:49 +01:00
f0d028d3a4 Update the Transform struct to support JSON updates 2020-10-31 20:52:49 +01:00