0e68718027
Add detailed spans
2024-07-31 13:05:47 +02:00
7c3fc8c655
Split settings and document facet string extractions
2024-07-31 10:57:46 +02:00
8acd3f50bb
skip normalization when the locales and values are the same
2024-07-31 09:53:00 +02:00
d4ea7cc2a9
fix clippy 👉 👈
2024-07-25 12:10:32 +02:00
2413592bbf
Display docid when there are documents without manual embeddings for a manual embedder
2024-07-25 12:10:32 +02:00
4654d51e05
Add custom headers for REST embedder
2024-07-25 12:01:51 +02:00
04fa44e7eb
Implement localized attributes settings
2024-07-25 10:51:27 +02:00
cc02920f2b
Update charabia
2024-07-25 10:51:27 +02:00
988552e178
add tests on the rest embedder
2024-07-24 14:34:17 +02:00
24240934f9
Improve errors when indexing documents with a user provided embedder
2024-07-16 13:39:01 +02:00
6e80364c50
Apply review comments
2024-07-11 11:00:27 +02:00
837274f853
Restrict even more the Rhai engine
2024-07-10 16:30:18 +02:00
aace587dd1
Create errors for the internal processing ones
2024-07-10 16:29:18 +02:00
81ec0abad1
Use the new rayon-par-bridge library
2024-07-10 16:29:04 +02:00
b67d385cf0
Parallelize the edition functions
2024-07-10 16:28:54 +02:00
2eae2015d7
Support aborting documents edition by function
2024-07-10 16:28:15 +02:00
33fa17bf12
Support deleting documents with functions
2024-07-10 16:28:15 +02:00
400e6b93ce
Support user-provided context for documents edition
2024-07-10 16:28:15 +02:00
f4add93043
Limit the number of script operations
2024-07-10 16:28:14 +02:00
2fae96ac14
Show the actual number of actually edited documents
2024-07-10 16:28:14 +02:00
45af18ae9c
Check the Rhai syntax before accepting the script
2024-07-10 16:28:13 +02:00
2d97164d9f
It works perfectly with some Rhai
2024-07-10 16:28:13 +02:00
efc156a4a4
Executing Lua works correctly
2024-07-10 16:27:36 +02:00
2099b4f0dd
Merge #4786
...
4786: Update dependencies r=Kerollmops a=irevoire
# Pull Request
## Related issue
Fixes #4753
## What does this PR do?
- Update all dependencies except rustls
- [x] Release charabia
- [x] Update charabia
- [x] Double check that the docker build works after updating charabia
Co-authored-by: Tamo <tamo@meilisearch.com >
Co-authored-by: Clément Renault <clement@meilisearch.com >
2024-07-10 13:23:54 +00:00
0a40a98bb6
Make milli use edition 2021 ( #4770 )
...
* Make milli use edition 2021
* Add lifetime annotations to milli.
* Run cargo fmt
2024-07-09 17:25:39 +02:00
cd46ebd6b5
remove insta deprecating
2024-07-08 18:38:05 +02:00
1693332cab
Update arroy and always build the tree that need to be built
2024-06-24 10:14:03 +02:00
ddd564665b
Merge #4713
...
4713: Speed up facet distribution r=ManyTheFish a=Kerollmops
This PR is akin to #4682 , but this time, the same logic is applied to the facets. Bitmaps are not decoded, and we do an intersection on the bytes with the search candidates instead of materializing the RoaringBitmap to destroy it just after the operation.
A prospect raised some slow requests when performing facet searches, and I found out that the disk optimization intersection wasn't performed on the facets.
Co-authored-by: Clément Renault <clement@meilisearch.com >
2024-06-24 05:23:46 +00:00
9736e16a88
Make clippy happy
2024-06-20 13:02:44 +02:00
a04041c8f2
Only spawn the pool once
2024-06-19 16:25:33 +02:00
0a8f50695e
Fixes for Rust v1.79
2024-06-13 17:47:44 +02:00
e35ef31738
Small changes following review
2024-06-13 14:20:48 +02:00
3bc8f81abc
user_provided => regenerate
2024-06-12 18:12:20 +02:00
a89eea233b
Fix vectors injection
2024-06-12 17:10:19 +02:00
f5cf01e7d1
Rework extraction to use EmbedderAction
2024-06-12 14:50:55 +02:00
d1dd7e5d09
In transform for removed embedders, write back their user provided vectors in documents, and clear the writers
2024-06-12 14:50:55 +02:00
7cef2299cf
Fix behavior when removing a document
2024-06-11 09:45:08 +02:00
2cdcb703d9
fix the deletion of vectors and add a test
2024-06-06 11:39:29 +02:00
d85ab23b82
rename all occurences of user_defined to user_provided for consistency
2024-06-06 11:39:29 +02:00
b7349910d9
implements mor review comments
2024-06-06 11:39:29 +02:00
376b3a19a7
makes clippy and fmt happy
2024-06-06 11:39:29 +02:00
5d50850e12
always push the user defined vectors in arroy
2024-06-06 11:39:29 +02:00
a73ccc78a6
forward the embedding config to the extractors
2024-06-06 11:39:28 +02:00
9eb6f522ea
wraps the index embedding config in a struct
2024-06-06 11:37:30 +02:00
84e498299b
Remove the vectors from the documents database
2024-06-06 11:36:11 +02:00
b833be46b9
Avoid running proximity when only the exact attributes changes
2024-06-05 17:30:07 +02:00
261e92d7e6
Skip iterating over documents when the faceted field list doesn't change
2024-06-05 17:30:07 +02:00
5cd08979b1
iterate over the faceted fields instead of over the whole document
2024-06-05 17:30:07 +02:00
b81953a65d
Add a span for the prepare_for_documents_reindexing
2024-06-05 17:30:07 +02:00
1b639ce44b
Reduce the number of complex calls to settings diff functions
2024-06-05 17:30:07 +02:00
