e83534a430
Fix the indexer::index to correctly use the rayon::ThreadPool
2024-11-27 16:27:43 +01:00
98d4a2909e
Fix the way we spawn the rayon threadpool
2024-11-27 16:05:44 +01:00
cc63802115
Modify and return the IndexEmbeddings to write them later
2024-11-27 14:58:03 +01:00
acec45ad7c
Send a WakeUp when writing data in the BBQueue buffers
2024-11-27 14:33:23 +01:00
70802eb7c7
Fix most issues with the lifetimes
2024-11-27 14:32:42 +01:00
6ac5b3b136
Finish most of the channels types
2024-11-27 14:32:26 +01:00
2094ce8a9a
Move the arroy building after the writing loop
2024-11-27 14:30:33 +01:00
8442db8101
Implement mostly all senders
2024-11-27 14:16:35 +01:00
a2f64f6552
Merge #5095
...
Test suite / Tests on ${{ matrix.os }} (macos-13) (push) Waiting to run
Test suite / Tests almost all features (push) Has been skipped
Test suite / Test disabled tokenization (push) Has been skipped
Test suite / Tests on ubuntu-20.04 (push) Failing after 13s
Test suite / Run tests in debug (push) Failing after 12s
Test suite / Tests on ${{ matrix.os }} (windows-2022) (push) Failing after 40s
Test suite / Run Rustfmt (push) Successful in 1m46s
Test suite / Run Clippy (push) Successful in 9m55s
5095: Span to measure the part of db writes that is after the merge/extraction r=curquiza a=dureuill
Co-authored-by: Louis Dureuil <louis@meilisearch.com >
2024-11-27 11:10:00 +00:00
d0b2c0a523
Merge #5091
...
Test suite / Tests on ${{ matrix.os }} (macos-13) (push) Waiting to run
Test suite / Tests almost all features (push) Has been skipped
Test suite / Test disabled tokenization (push) Has been skipped
Test suite / Tests on ubuntu-20.04 (push) Failing after 11s
Test suite / Run tests in debug (push) Failing after 10s
Test suite / Tests on ${{ matrix.os }} (windows-2022) (push) Failing after 39s
Test suite / Run Rustfmt (push) Successful in 1m38s
Test suite / Run Clippy (push) Successful in 23m11s
5091: Settings opt out r=Kerollmops a=ManyTheFish
# Pull Request
Related PRD: https://www.notion.so/meilisearch/API-usage-Settings-to-opt-out-indexing-features-fff4b06b651f8108ade3f858aeb16b14?pvs=4
## Related issue
Fixes #4979
- [x] Add setting opt-out
- [x] Add analytics
- [x] Add tests
Co-authored-by: ManyTheFish <many@meilisearch.com >
Co-authored-by: Many the fish <many@meilisearch.com >
2024-11-26 15:50:28 +00:00
8f57b4fdf4
Span to measure the part of db writes that is after the merge/extraction
2024-11-26 14:46:36 +01:00
aa460819a7
Add more precise spans
2024-11-26 09:45:36 +01:00
d66dc363ed
Test and implement settings opt-out
2024-11-25 18:23:22 +01:00
25aac45fc7
Expose better error messages
2024-11-25 15:54:43 +01:00
323ecbb885
Add span on document operation
2024-11-21 17:01:10 +01:00
5727e00374
Remove useless geo skipped
2024-11-21 16:47:08 +01:00
9b60843831
Remove commented lines
2024-11-21 16:47:07 +01:00
94b260fd25
Remove orphan span
2024-11-21 12:12:07 +01:00
ab2c83f868
Use the disk less when computing prefixes
2024-11-21 10:45:37 +01:00
e0864f1b21
Separate side effect and debug asserts
2024-11-20 16:25:17 +01:00
a38344acb3
Replace eprintlns by tracing
2024-11-20 15:29:51 +01:00
ff9c92c409
rename documents -> substep
2024-11-20 15:12:02 +01:00
867138f166
Add SP to into_changes
2024-11-20 15:07:05 +01:00
84600a10d1
Add MSP to document_update.into_changes()
2024-11-20 14:53:37 +01:00
7d64e8dbd3
Fix Windows compilation
2024-11-20 14:40:38 +01:00
cae8c89467
"fix" last warnings
2024-11-20 14:03:52 +01:00
3957917e0b
Correctly count indexed documents
2024-11-20 13:16:36 +01:00
651c30899e
Allow fetching embedders from inside tests
2024-11-20 13:16:36 +01:00
2c7a7fe4e8
Count the number of documents correctly
2024-11-20 13:16:35 +01:00
23f0c2c29b
Generate internal ids only when needed
2024-11-20 13:16:35 +01:00
3cf1352ae1
Fix the benchmark tests
2024-11-20 13:16:31 +01:00
c782c09208
Move step to a dedicated mod and replace it with an enum
2024-11-18 18:22:13 +01:00
75943a5a9b
Add TODO to remember replacing steps with an enum
2024-11-18 17:40:51 +01:00
04c38220ca
Move MostlySend, ThreadLocal, FullySend to their own commit
2024-11-18 16:43:05 +01:00
5f93651cef
fixes
2024-11-18 16:23:11 +01:00
5b4c06c24c
Plug the grenad max memory parameter
2024-11-18 11:28:04 +01:00
c202f3dbe2
fix tests and revert change in behavior when primary_key_from_op != primary_key_from_db && index.is_empty()
2024-11-18 10:59:05 +01:00
677d7293f5
Fix a lot of primary key related tests
2024-11-18 10:59:05 +01:00
83865d2ebd
Expose intermediate errors when processing batches
2024-11-18 10:59:05 +01:00
9e8367f1e6
Move the rayon thread pool outside the extract method
2024-11-14 10:40:32 +01:00
0e3c5d91ab
Document deletion test passes
2024-11-14 08:42:56 +01:00
695c2c6b99
Cosmetic fix
2024-11-14 08:42:39 +01:00
40dd25d6b2
Fix issue with Replace document method when adding and deleting a document in the same batch
2024-11-13 22:10:00 +01:00
51b6293738
Add linear facet databases
2024-11-13 17:43:02 +01:00
b17896d899
Finialize the GeoExtractor
2024-11-13 17:43:02 +01:00
7accfea624
Don't short circuit when we encounter a semantic error while extracting fields and external docid
2024-11-13 10:33:59 +01:00
6094bb299a
Fix user_provided vectors
2024-11-12 10:15:55 +01:00
8a314ab81d
Fix primary key fid order
2024-11-08 00:05:12 +01:00
d97af4d8e6
fix field order of JSON documents
2024-11-07 22:36:52 +01:00
1f5d801271
Fix crashes in facet search indexing
2024-11-07 17:22:30 +01:00
