Commit Graph

109 Commits

Author SHA1 Message Date
432974b0ff Dispatch the vector store based on the index version 2025-08-13 13:41:10 +02:00
d51c60dd12 Make the VectorStore aware of the index version 2025-08-13 13:41:10 +02:00
9ef8c53b8c Expose Hannoy progress when upgrading 2025-08-13 13:41:10 +02:00
b3f77ecbe1 First version of Hannoy dumpless upgrade 2025-08-13 13:41:09 +02:00
7c6c6bed11 Integrate the hannoy progress 2025-08-13 13:40:26 +02:00
52f9213247 wip: Use Hamming when binary quantized 2025-08-13 13:40:25 +02:00
bd805c0a3f Always use at least an ef = 100 when searching 2025-08-13 13:40:25 +02:00
8c52636690 Add a missing cancelation call for hannoy 2025-08-13 13:40:23 +02:00
55b06031bb Reintroduce changing the distance from Cosine to Cosine binary quantized 2025-08-13 13:40:22 +02:00
adf40be9a0 Bump Hannoy's version 2025-08-13 13:40:22 +02:00
ac893552b7 Increase efSearch from x2 to x10 2025-08-13 13:40:21 +02:00
5f2607d148 Increase efConstruction from 48 to 125 2025-08-13 13:40:20 +02:00
b4df747547 remove-me: Introduce an env var to change the embeddings chunk size 2025-08-13 13:40:19 +02:00
2245121f1d Rename the ArroyWrapper/HannoyWrapper into VectorStore 2025-08-13 13:40:13 +02:00
7d1c0a508e Use constants as the hannoy default parameters 2025-08-13 13:40:12 +02:00
27ad20bc6b Use Hannoy instead of arroy 2025-08-13 13:40:11 +02:00
a0b71a8785 EmbedderOptions::has_fragments() 2025-07-21 15:11:24 +02:00
058f9ffda5 Merge pull request #5734 from meilisearch/request-fragments-test
Tests for multimodal
2025-07-16 11:04:00 +00:00
3261aadcf2 Add composite test 2025-07-07 16:50:39 +02:00
073e9f2967 Disable similarity check on composite embedders using fragments 2025-07-07 16:46:16 +02:00
a3254d7d7d Implement dumpless upgrade from v1.15 to v1.16 2025-07-07 11:57:08 +02:00
dfe0c8664e Add a version of prompt::Context that has no fields 2025-07-03 11:08:31 +02:00
87f105747f Add documentation to Extractor trait 2025-07-03 10:41:20 +02:00
735634e998 Send owned metadata and clear inputs in case of error 2025-07-03 10:32:57 +02:00
3740755d9c Compare to RawValue::NULL constant rather than explicit "null" 2025-07-03 10:11:07 +02:00
a06cb1bfd6 Remove Embed::process_embeddings and have it be an inherent function of the type that uses it 2025-07-03 10:02:16 +02:00
428463e45c Check indexing fragments as well as search fragments 2025-07-02 16:17:22 +02:00
7113fcf63a New error 2025-07-02 16:17:12 +02:00
82a796aea7 vector settings: fix bug where removed fragments were returned as new 2025-07-02 11:36:50 +02:00
f6287602e9 Improve error message when request contains the wrong type of placeholder 2025-07-02 11:36:50 +02:00
ede456c5b0 New error: rest inconsistent fragments 2025-07-02 11:36:50 +02:00
3f5b5df139 Check consistency of fragments 2025-07-02 11:36:50 +02:00
d72e5f5f69 Hide documentTemplate and documentTemplateMaxBytes when indexing_fragment is defined 2025-07-02 11:29:50 +02:00
eda309d562 make sure fragments are ordered 2025-07-02 00:05:13 +02:00
2b2e6c0b3a Settings changes 2025-07-02 00:05:13 +02:00
9ce5598fef parsed vectors: embeddings is None when it is null when read from DB 2025-07-02 00:05:13 +02:00
cab5e35ff7 Implement in old settings indexer and old dump import indexer 2025-07-02 00:05:12 +02:00
f8232976ed Implement in new document indexer 2025-07-02 00:05:12 +02:00
f3d5c74c02 Vector settings to add indexingFragments and searchFragments 2025-07-02 00:05:12 +02:00
c45ede44a8 Add new parameters to openai and rest embedders 2025-07-02 00:05:11 +02:00
4235a82dcf REST embedder supports fragments 2025-07-02 00:05:11 +02:00
e7b9b8f002 Change embedder API 2025-07-02 00:05:11 +02:00
422a786ffd RuntimeEmbedder and RuntimeFragments 2025-07-02 00:05:11 +02:00
836ae19bec ArroyWrapper changes 2025-07-02 00:05:11 +02:00
0b5bc41b79 Add new vector errors 2025-07-02 00:05:11 +02:00
b45059e8f2 Add vector::session module 2025-07-02 00:05:11 +02:00
c16c60b599 Add vector::extractor module 2025-07-02 00:05:11 +02:00
17a94c40dc Add vector::db module 2025-07-02 00:05:10 +02:00
76ca44b214 Expand json_template module 2025-07-02 00:05:10 +02:00
29f6eeff8f Remove lots of Arcs 2025-06-26 12:15:08 +02:00