68a2502388
Introduce indexer level bumpalo
2024-10-10 22:23:05 +02:00
14261f8f04
Integrate facet level bulk update
...
Only the facet bulk update has been added so far, the incremental must be completely rewritten
Factorize facet merging
Fix facet level extraction
2024-10-03 11:13:00 +02:00
d79f75f630
Compute and Write external-documents-ids database
2024-10-03 11:11:56 +02:00
bb7a503e5d
Compute prefix databases
...
We are now computing the prefix FST and a prefix delta in the Merger thread,
after all the databases are written, the main thread will recompute the prefix databases based on the prefix delta without needing any grenad temporary file anymore
2024-10-01 09:57:06 +02:00
3f7a500f3b
Build prefix fst
2024-09-25 14:36:06 +02:00
e0c7067355
Expose an IndexedParallelIterator to the index function
2024-09-24 17:24:59 +02:00
6e87332410
Change the way the FST is built
2024-09-24 16:28:31 +02:00
7ba49b849e
Extract and write facet databases
2024-09-16 09:35:16 +02:00
f7652186e1
WIP geo fields
2024-09-12 18:01:02 +02:00
aa69308e45
Use a bufWriter to build word FSTs
2024-09-12 11:48:00 +02:00
8fd99b111b
Add tracing timers logs
2024-09-05 18:00:22 +02:00
73ce67862d
Use the word pair proximity and fid word count docids extractors
...
Co-authored-by: ManyTheFish <many@meilisearch.com >
2024-09-05 10:56:22 +02:00
19d937ab21
Introduce the facet extractors
2024-09-04 17:03:54 +02:00
1d59c19cd2
Send the WordsFst by using an Mmap
2024-09-04 14:30:09 +02:00
98e48371c3
Factorize some stuff
2024-09-04 12:17:13 +02:00
6d74fb0229
Introduce the WordFidWordDocids database
2024-09-04 11:40:55 +02:00
27b4cab857
Extract and write the documents and words fst in the database
2024-09-04 09:59:19 +02:00
52d32b4ee9
Move the channel sender in the closure to stop the merger thread
2024-09-03 16:08:33 +02:00
c50d3edc4a
Integrate first searchable exctrator
2024-09-03 11:02:39 +02:00
e639ec79d1
Move the indexers into their own modules
2024-09-02 10:42:19 +02:00
