bors[bot] 8efac33b53

Merge #467 ...

467: optimize prefix database r=Kerollmops a=MarinPostma

This pr introduces two optimizations that greatly improve the speed of computing prefix databases.

- The time that it takes to create the prefix FST has been divided by 5 by inverting the way we iterated over the words FST.
- We unconditionally and needlessly checked for documents to remove in  `word_prefix_pair`, which caused an iteration over the whole database.

Co-authored-by: ad hoc <postma.marin@protonmail.com>

2022-03-15 16:14:35 +00:00

..

index_documents

Replace the ugly unwraps by clean if let Somes

2022-02-28 16:31:33 +01:00

available_documents_ids.rs

Remove the roaring operation functions warnings

2021-06-30 14:12:56 +02:00

clear_documents.rs

get rid of chrono in favor of time

2022-02-15 11:41:55 +01:00

delete_documents.rs

Fix the compilation error of the dependency versions

2022-03-15 11:17:45 +01:00

facets.rs

Merge #436

2022-02-16 15:41:14 +00:00

indexer_config.rs

document batch support

2022-01-19 12:40:20 +01:00

mod.rs

document batch support

2022-01-19 12:40:20 +01:00

settings.rs

get rid of chrono in favor of time

2022-02-15 11:41:55 +01:00

update_step.rs

Implement documents format

2021-09-21 16:58:33 +02:00

word_prefix_docids.rs

Avoid iterating on big databases when useless

2022-03-09 15:43:54 +01:00

word_prefix_pair_proximity_docids.rs

optimize word prefix pair

2022-03-15 16:37:22 +01:00

words_prefix_position_docids.rs

Avoid iterating on big databases when useless

2022-03-09 15:43:54 +01:00

words_prefixes_fst.rs

review edits

2022-03-15 17:12:48 +01:00