198238687f
Guess and retrieve primary key correctly in batch
2024-10-16 09:27:18 +02:00
f9a6c624a7
Put primary key, and use provided key in operation
2024-10-16 09:27:00 +02:00
017757004e
Add PrimaryKey::new_or_insert
2024-10-16 09:26:18 +02:00
152683083b
Change document operation to use method in primary key
2024-10-15 14:08:37 +02:00
c283c95f6a
Support nested primary keys
2024-10-15 14:08:37 +02:00
9a0e1dc375
Fix the prefix deletion
2024-10-15 11:20:09 +02:00
1e81d72b5f
Use the fixed version of the Rhai crate
2024-10-14 18:18:59 +02:00
52b95c4e59
Make sure we edit the task statuses
2024-10-14 16:48:15 +02:00
7e1dc8439b
Introduce the new update by function
2024-10-14 16:32:50 +02:00
96658ec775
Make de public
2024-10-14 15:41:58 +02:00
c01ee7b732
external changes
2024-10-14 15:41:58 +02:00
6ad3f57bc1
Changes to de
2024-10-14 15:41:58 +02:00
28d92c521a
External docids to &'bump str
2024-10-14 15:41:58 +02:00
7df20d8282
Changes to primary key
2024-10-14 15:41:57 +02:00
b4102741e6
Fix duplicated fields when a document is modified
2024-10-14 14:59:40 +02:00
a525598ad6
Fix facet string indexing
2024-10-14 11:12:10 +02:00
4e97e38177
Serialize docids bitmap one time
2024-10-14 11:12:10 +02:00
d675e73af1
Finish prefix databases
2024-10-14 11:12:10 +02:00
a2fbf2ea21
set updated at at the end of the indexing
2024-10-14 11:05:25 +02:00
132916f62c
Only run word pair proximity docids extraction if proximity_precision enables it
2024-10-14 11:05:25 +02:00
8371819114
Some clippy related fixes
2024-10-14 10:58:37 +02:00
6028d6ba43
Remove somme warnings
2024-10-10 22:42:37 +02:00
68a2502388
Introduce indexer level bumpalo
2024-10-10 22:23:05 +02:00
39b27e42be
Plug the deletion pipeline
2024-10-08 16:04:19 +02:00
470c2272dd
Show much more stats about the LRU caches
2024-10-08 15:29:24 +02:00
2230674c0a
Merge branch 'fix-append-only-vec' into indexer-edition-2024
2024-10-08 10:32:45 +02:00
eb09dfed04
Avoid reallocation with the ThreadLocal pool
2024-10-07 16:41:17 +02:00
83c09d0db0
Remove the now, useless AppendOnlyVec library
2024-10-07 16:38:45 +02:00
c11b7e5c0f
Reduce number of cache created by using thread_local
2024-10-07 15:58:16 +02:00
dff2d54784
Merge pull request #4976 from meilisearch/fix-append-only-vec
...
Fix append only `Vec` by using a `LinkedList`
2024-10-03 17:26:00 +02:00
58d96fbea3
Rename Node parent to next
2024-10-03 16:15:05 +02:00
4665bfcb19
Move the parent assignation before the exchange operation
2024-10-03 16:14:23 +02:00
a7a01646cf
Remove the useless Manually drop
2024-10-03 15:57:31 +02:00
0409a26cd8
Replace the concurrent vec by a linked list
2024-10-03 15:15:29 +02:00
35f78b5423
TO REMOVE: usefull debug prints
2024-10-03 11:13:01 +02:00
14261f8f04
Integrate facet level bulk update
...
Only the facet bulk update has been added so far, the incremental must be completely rewritten
Factorize facet merging
Fix facet level extraction
2024-10-03 11:13:00 +02:00
774ed28539
Fix Prefix FST when a document is modified
2024-10-03 11:12:26 +02:00
d79f75f630
Compute and Write external-documents-ids database
2024-10-03 11:11:56 +02:00
ccf01c2471
Merge pull request #4969 from meilisearch/indexer-edition-2024-try-map
...
Indexer edition 2024 try map
2024-10-02 11:25:05 +02:00
b7a5ba100e
Move the ParallelIteratorExt into the parallel_iterator_ext module
2024-10-01 11:11:52 +02:00
dead7a56a3
Keep the caches in the AppendOnlyVec
2024-10-01 11:11:39 +02:00
0a8cb471df
Introduce the AppendOnlyVec struct for the parallel computing
2024-10-01 11:11:25 +02:00
00e045b249
Rename and use the try_arc_for_each_try_init method
2024-10-01 11:11:25 +02:00
d83c9a4074
Introduce the try_for_each_try_init method to be used with Arced Errors
2024-10-01 11:11:25 +02:00
f3356ddaa4
Fix the errors when using the try_map_try_init method
2024-10-01 11:11:10 +02:00
31de5c747e
WIP using try_map_try_init
2024-10-01 11:10:53 +02:00
3843240940
Prefer using Ars instead of Options
2024-10-01 11:10:53 +02:00
8cb5e7437d
try using try_map_try_init
2024-10-01 11:10:53 +02:00
5b776556fe
Add ParallelIteratorExt
2024-10-01 11:10:53 +02:00
bb7a503e5d
Compute prefix databases
...
We are now computing the prefix FST and a prefix delta in the Merger thread,
after all the databases are written, the main thread will recompute the prefix databases based on the prefix delta without needing any grenad temporary file anymore
2024-10-01 09:57:06 +02:00
