1b1703a609
make a small optimization to merge obkvs a little bit faster
2023-02-14 18:32:41 +01:00
fb5e4957a6
fix and test the early exit in case a grenad ends with a deletion
2023-02-14 18:23:57 +01:00
8de3c9f737
Update milli/src/update/index_documents/transform.rs
...
Co-authored-by: Clément Renault <clement@meilisearch.com >
2023-02-14 17:57:14 +01:00
43a19d0709
document the operation enum + the grenads
2023-02-14 17:55:26 +01:00
a53536836b
fmt
2023-02-14 17:04:22 +01:00
d7ad39ad77
fix: clippy error
2023-02-14 00:15:35 +01:00
849de089d2
add thiserror for AscDescError
2023-02-14 00:15:35 +01:00
7f25007d31
Update milli/src/asc_desc.rs
...
Co-authored-by: Tamo <irevoire@protonmail.ch >
2023-02-14 00:15:35 +01:00
c810af3ebf
implement From<ParseGeoError> for AscDescError
2023-02-14 00:15:35 +01:00
c0b77773ba
fmt asc_desc
2023-02-14 00:15:35 +01:00
7481559e8b
move BadGeo to FilterError
2023-02-14 00:15:35 +01:00
83c765ce6c
implement From<ParseGeoError> for FilterError
2023-02-14 00:15:35 +01:00
4c91037602
use ParseGeoError in sort parser
2023-02-14 00:15:35 +01:00
825923f6fc
export ParseGeoError
2023-02-14 00:15:35 +01:00
e405702733
chore: introduce new error ParseGeoError type
2023-02-14 00:15:35 +01:00
6fa877efb0
Fix attributes set candidates
2023-02-13 17:49:52 +01:00
746b31c1ce
makes clippy happy
2023-02-09 12:23:01 +01:00
93db755d57
add a test to ensure we handle correctly a deletion of multiple time the same document
2023-02-08 21:03:34 +01:00
93f130a400
fix all warnings
2023-02-08 20:57:35 +01:00
421a9cf05e
provide a new method on the transform to remove documents
2023-02-08 16:06:09 +01:00
8f64fba1ce
rewrite the current transform to handle a new byte specifying the kind of operation it's merging
2023-02-08 12:53:38 +01:00
c88c3637b4
Merge #3461
...
3461: Bring v1 changes into main r=curquiza a=Kerollmops
Also bring back changes in milli (the remote repository) into main done during the pre-release
Co-authored-by: Loïc Lecrenier <loic.lecrenier@me.com >
Co-authored-by: bors[bot] <26634292+bors[bot]@users.noreply.github.com>
Co-authored-by: curquiza <curquiza@users.noreply.github.com >
Co-authored-by: Tamo <tamo@meilisearch.com >
Co-authored-by: Philipp Ahlner <philipp@ahlner.com >
Co-authored-by: Kerollmops <clement@meilisearch.com >
2023-02-07 11:27:27 +00:00
42114325cd
Apply suggestions from code review
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com >
2023-02-06 18:07:00 +01:00
7a38fe624f
throw an error if the top left corner is found below the bottom right corner
2023-02-06 17:50:47 +01:00
1b005f697d
update the syntax of the geoboundingbox filter to uses brackets instead of parens around lat and lng
2023-02-06 16:50:27 +01:00
fbec48f56e
Merge remote-tracking branch 'milli/main' into bring-v1-changes
2023-02-06 16:48:10 +01:00
3ebc99473f
Apply suggestions from code review
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com >
2023-02-06 13:29:37 +01:00
d27007005e
comments the geoboundingbox + forbid the usage of the lexeme method which could introduce bugs
2023-02-06 11:36:49 +01:00
fcb09ccc3d
add tests on the geoBoundingBox
2023-02-02 18:19:56 +01:00
ae8660e585
Add Token::original_span rather than making Token::span pub
2023-02-02 15:03:34 +01:00
b297b5deb0
cargo fmt
2023-02-02 12:34:49 +01:00
0d71c80ba6
add tests
2023-02-02 12:31:27 +01:00
65a3086cf1
fix test
2023-02-02 12:27:58 +01:00
426d63b01b
Update insta test suite
2023-02-02 12:27:56 +01:00
b078477d80
Add error handling and earth lap collision with bounding box
2023-02-02 12:17:38 +01:00
0bc1a18f52
Use Languages list detected during indexing at search time
2023-02-01 18:57:43 +01:00
643d99e0f9
Add expectancy test
2023-02-01 18:39:54 +01:00
064158e4e2
Update test
2023-02-01 15:34:01 +01:00
77d32d0ee8
Fix codec deserialization
2023-02-01 15:26:26 +01:00
a2690ea8d4
Reduce incremental indexing time of words_prefix_position_docids DB
...
This database can easily contain millions of entries. Thus, iterating
over it can be very expensive.
For regular `documentAdditionOrUpdate` tasks, `del_prefix_fst_words`
will always be empty. Thus, we can save a significant amount of time
by adding this `if !del_prefix_fst_words.is_empty()` condition.
The code's behaviour remains completely unchanged.
2023-01-31 11:42:24 +01:00
2922c5c899
Fix code format
2023-01-31 11:28:05 +01:00
7681be5367
Format code
2023-01-31 11:28:05 +01:00
50bc156257
Fix tests
2023-01-31 11:28:05 +01:00
d8207356f4
Skip script,language insertion if language is undetected
2023-01-31 11:28:05 +01:00
2d58b28f43
Improve script language codec
2023-01-31 11:28:05 +01:00
fd60a39f1c
Format code
2023-01-31 11:28:05 +01:00
369c05732e
Add test checking if from script_language_docids database were removed
...
deleted docids
2023-01-31 11:28:05 +01:00
34d04f3d3f
Filter from script_language_docids database soft deleted documents
2023-01-31 11:28:05 +01:00
a27f329e3a
Add tests for checking that detected script and language associated with document(s) were stored during indexing
2023-01-31 11:28:05 +01:00
b216ddba63
Delete and clear data from the new database
2023-01-31 11:28:05 +01:00
