5d149d631f
Remove tests for a function that no more exists
2022-07-12 15:14:06 +02:00
0bbcc7b180
Expose the DocumentId struct to be sure to inject the generated ids
2022-07-12 15:14:06 +02:00
905af2a2e9
Use the primary key and external id in the transform
2022-07-12 15:14:05 +02:00
6a0a0ae94f
Make the Transform read from an EnrichedDocumentsBatchReader
2022-07-12 14:55:52 +02:00
8ebf5eed0d
Make the nested primary key work
2022-07-12 14:55:52 +02:00
fcfc4caf8c
Move the Object type in the lib.rs file and use it everywhere
2022-07-12 14:55:51 +02:00
0146175fe6
Introduce the validate_documents_batch function
2022-07-12 14:55:51 +02:00
bdc4263883
Introduce the validate_documents_batch function
2022-07-12 14:55:51 +02:00
e8297ad27e
Fix the tests for the new DocumentsBatchBuilder/Reader
2022-07-12 14:52:56 +02:00
ebddfdb9a3
Merge #578
...
578: Bump uuid to 1.1.2 r=ManyTheFish a=Kerollmops
Just to [align the version with Meilisearch](https://github.com/meilisearch/meilisearch/pull/2584 ).
Co-authored-by: Kerollmops <clement@meilisearch.com >
2022-07-05 14:56:08 +00:00
1bfdcfc84f
Bump uuid to 1.1.2
2022-07-05 16:23:36 +02:00
3b309f654a
Fasten the document deletion
...
When a document deletion occurs, instead of deleting the document we mark it as deleted
in the new “soft deleted” bitmap. It is then removed from the search, and all the other
endpoints.
2022-07-05 15:30:33 +02:00
d0aaa7ff00
Fix wrong internal ids assignments
2022-06-07 15:49:33 +02:00
f19d2dc548
Only flatten the required fields
...
apply review comments
Co-authored-by: Kerollmops <kero@meilisearch.com >
2022-04-26 12:33:46 +02:00
00f78d6b5a
Apply code suggestions
...
Co-authored-by: Clément Renault <clement@meilisearch.com >
2022-04-14 11:14:08 +02:00
399fba16bb
only flatten an object if it's nested
2022-04-14 11:14:08 +02:00
ee64f4a936
Use smartstring to store the external id in our hashmap
...
We need to store all the external id (primary key) in a hashmap
associated to their internal id during.
The smartstring remove heap allocation / memory usage and should
improve the cache locality.
2022-04-13 21:22:07 +02:00
4f3ce6d9cd
nested fields
2022-04-07 16:58:46 +02:00
f367cc2e75
Finally bump grenad to v0.4.1
2022-02-16 15:28:48 +01:00
0c84a40298
document batch support
...
reusable transform
rework update api
add indexer config
fix tests
review changes
Co-authored-by: Clément Renault <clement@meilisearch.com >
fmt
2022-01-19 12:40:20 +01:00
3599df77f0
Change some error messages
2021-10-27 19:33:01 +02:00
baddd80069
implement review suggestions
2021-10-25 18:29:12 +02:00
430e9b13d3
add csv builder tests
2021-10-25 10:26:43 +02:00
0f86d6b28f
implement csv serialization
2021-10-25 10:26:42 +02:00
86ead92ed5
infer primary key on sorted fields
2021-10-12 11:15:11 +02:00
9a266a531b
test correct primary key inference
2021-10-12 11:08:53 +02:00
f65153ad64
stop casting integer docids to string
2021-09-28 18:35:54 +02:00
aa6c5df0bc
Implement documents format
...
document reader transform
remove update format
support document sequences
fix document transform
clean transform
improve error handling
add documents! macro
fix transform bug
fix tests
remove csv dependency
Add comments on the transform process
replace search cli
fmt
review edits
fix http ui
fix clippy warnings
Revert "fix clippy warnings"
This reverts commit a1ce3cd96e603633dbf43e9e0b12b2453c9c5620.
fix review comments
remove smallvec in transform loop
review edits
2021-09-21 16:58:33 +02:00
9961b78b06
Drop sorter before creating a new one
2021-09-08 13:30:26 +02:00
1d314328f0
Plug new indexer
2021-09-01 16:48:36 +02:00
838ed1cd32
Use an u16 field id instead of one byte
2021-07-06 11:58:03 +02:00
0cca2ea24f
Return a MissingDocumentId when a document doesn't have one
2021-06-22 11:22:33 +02:00
daef43f504
Rename FieldsDistribution into FieldDistribution
2021-06-21 15:57:41 +02:00
d08cfda796
convert the field_distribution to a BTreeMap and avoid counting twice the same documents
2021-06-17 18:31:54 +02:00
969adaefdf
rename fields_distribution in field_distribution
2021-06-17 15:16:20 +02:00
9716fb3b36
format the whole project
2021-06-16 18:33:33 +02:00
713acc408b
Introduce the primary key to the Settings builder structure
2021-06-16 11:03:36 +02:00
28c004aa2c
Prefer using constant for the database names
2021-06-15 11:13:04 +02:00
312c2d1d8e
Use the Error enum everywhere in the project
2021-06-14 16:58:38 +02:00
65b1d09d55
Move the obkv merging functions into the merge_function module
2021-06-14 16:48:51 +02:00
ff9414a6ba
Use the out of the compute_primary_key_pair function
2021-06-14 16:48:50 +02:00
57898d8a90
fix silent deserialize error
2021-06-03 10:42:55 +02:00
eeb0c70ea2
meilisearch compatible primary key inference
2021-05-06 22:42:32 +02:00
f8d0f5265f
fix(update): fields distribution after documents merge
2021-05-04 22:12:20 +03:00
2658c5c545
feat(index): update fields distribution in clear & delete operations
...
fixes after review
bump the version of the tokenizer
implement a first version of the stop_words
The front must provide a BTreeSet containing the stop words
The stop_words are set at None if an empty Set is provided
add the stop-words in the http-ui interface
Use maplit in the test
and remove all the useless drop(rtxn) at the end of all tests
Integrate the stop_words in the querytree
remove the stop_words from the querytree except if it was a prefix or a typo
more fixes after review
2021-04-01 19:12:35 +03:00
27c7ab6e00
feat(index): store fields distribution in index
2021-04-01 18:35:19 +03:00
e08b6b3ec7
add primary key to fields_id_map when not present
2021-03-01 16:10:16 +01:00
89ce4e74fe
Do not change the primary key type when we serialize documents
2021-02-15 21:24:36 +01:00
e8639517da
Change the project to become a workspace with milli as a default-member
2021-02-12 16:15:09 +01:00
