Commit Graph

14 Commits

Author SHA1 Message Date
510a4b91be Introduce DatabaseDocument type 2025-06-26 18:14:48 +02:00
e704f4d1ec Reimplement reindexing shell 2025-06-26 18:14:48 +02:00
29f6eeff8f Remove lots of Arcs 2025-06-26 12:15:08 +02:00
d08e89ea3d Remove options 2025-06-24 15:10:15 +02:00
d7721fe607 Format 2025-06-24 12:20:22 +02:00
4925b30196 Move embedder stats out of progress 2025-06-23 15:24:14 +02:00
cb16baab18 Add more progress levels to measure merging 2025-03-17 10:13:29 +01:00
ae8d453868 Refactor Document indexing process (searchables)
**Changes:**
The searchable database extraction is now relying on the AttributePatterns and FieldIdMapWithMetadata to match the field to extract.
Remove the SearchableExtractor trait to make the code less complex.

**Impact:**
- Document Addition/modification searchable indexing
- Document deletion searchable indexing
2025-03-03 10:32:42 +01:00
9f3663e768 Implement Incremental document database stats computing 2025-02-26 17:01:35 +01:00
76fd5d92d7 Clarify the tail writing to database 2025-02-20 17:35:23 +01:00
05cc8c650c Expose the write channel congestion in the batches 2025-02-19 15:47:54 +01:00
424c5bde40 Move the embedding computation and extraction log to debug 2025-01-29 16:40:36 +01:00
c14967eeac Use new incremental facet indexing and enable sanity checks in debug 2025-01-09 10:36:35 +01:00
de7f8c4406 refactor indexer mod 2025-01-07 15:29:02 +01:00