Commit Graph

12439 Commits

Author SHA1 Message Date
246290ef05 Make cargo insta happy 2025-08-18 16:41:51 +02:00
e2803da5bc Remove the vector_store reference 2025-08-18 16:41:51 +02:00
3c59702e70 Depend on Hannoy from crates.io 2025-08-18 16:41:51 +02:00
d08b62db7d Move code to the right file 2025-08-18 16:41:48 +02:00
27d2cd7bd2 Make cargo fmt happy 2025-08-18 16:38:13 +02:00
619900e4d3 Make clippy happy 2025-08-18 16:38:13 +02:00
24b017e367 Dispatch the vector store based on the index version 2025-08-18 16:38:13 +02:00
e64852208c Make the VectorStore aware of the index version 2025-08-18 16:38:13 +02:00
e4b28464fd Expose Hannoy progress when upgrading 2025-08-18 16:38:13 +02:00
de90455809 First version of Hannoy dumpless upgrade 2025-08-18 16:37:38 +02:00
ca5dc1b032 Integrate the hannoy progress 2025-08-18 16:23:05 +02:00
5c464e9855 wip: Use Hamming when binary quantized 2025-08-18 16:23:05 +02:00
114d50dfba Always use at least an ef = 100 when searching 2025-08-18 16:23:05 +02:00
6f0249cffc Switch to hannoy with support for deletions 2025-08-18 16:23:05 +02:00
e000df8646 Add a missing cancelation call for hannoy 2025-08-18 16:23:05 +02:00
900e8a0d9c Reintroduce changing the distance from Cosine to Cosine binary quantized 2025-08-18 16:23:05 +02:00
f5f173e451 Bump Hannoy's version 2025-08-18 16:23:05 +02:00
ce9d56377c Increase efSearch from x2 to x10 2025-08-18 16:23:05 +02:00
c2d912645f Increase efConstruction from 48 to 125 2025-08-18 16:23:05 +02:00
112d3f54e9 remove-me: Introduce an env var to change the embeddings chunk size 2025-08-18 16:23:05 +02:00
58a88c7933 Bump hannoy 2025-08-18 16:23:05 +02:00
203418ae49 Use a more feature-full Hannoy version 2025-08-18 16:23:05 +02:00
3bc192ae52 Reintroduce arroy and support for dumpless upgrade from previous versions 2025-08-18 16:23:04 +02:00
db9f205184 Rename the vector store const name and keep the vector-arroy db name 2025-08-18 16:23:04 +02:00
4d3a9dc43e Rename the ArroyWrapper/HannoyWrapper into VectorStore 2025-08-18 16:23:04 +02:00
9a2a40a4fa Use constants as the hannoy default parameters 2025-08-18 16:23:04 +02:00
bf921e9135 Use Hannoy instead of arroy 2025-08-18 16:23:04 +02:00
eda77aeb1a Fix snapshots 2025-08-18 16:23:04 +02:00
1fed0bed18 Remove erroneous untagged annotation 2025-08-18 16:23:04 +02:00
658023e01b camel case the fields in "origin" 2025-08-18 16:23:04 +02:00
b9c86e721f Rename Body::with_file 2025-08-18 16:23:04 +02:00
a29497f720 Adjust timeouts 2025-08-18 16:23:04 +02:00
1ae1856ec2 Don't always hardcode Content-Type in proxy 2025-08-18 16:23:03 +02:00
184e9f72c1 Update snap 2025-08-18 16:23:03 +02:00
4220c877e1 Misc churn 2025-08-18 16:23:03 +02:00
dcd6951a0b Move meilisearch_types::Network to its own module 2025-08-18 16:23:03 +02:00
1258bdb2b9 Make types Serialize and Deserialize for proxying 2025-08-18 16:23:03 +02:00
08f15cdf4b New errors 2025-08-18 16:23:03 +02:00
85e3267490 Dependency changes 2025-08-18 16:23:03 +02:00
753db805a8 IndexScheduler::update_task now merges the task.network and accepts &mut Task 2025-08-18 16:23:03 +02:00
bb52a8683a IndexScheduler::set_task_network 2025-08-18 16:23:03 +02:00
9a16c3a26d file-store: persist returns the persisted File object 2025-08-18 16:23:03 +02:00
708bb766b0 Dump support for network 2025-08-18 16:23:02 +02:00
be065c4c51 Proxy all document tasks to the network when sharding is enabled 2025-08-18 16:23:02 +02:00
cda5995922 Shard documents 2025-08-18 16:23:02 +02:00
409ae70f0f network: add sharding to Network and writeApiKey to Remotes 2025-08-18 16:23:02 +02:00
47b8e53985 Add proxy module to proxy requests to members of a network 2025-08-18 16:23:02 +02:00
eadd1bb5b5 Add new milli::update:🆕:indexer::sharding module 2025-08-18 16:23:02 +02:00
3a84f27738 Add network to Task and TaskView 2025-08-18 16:23:02 +02:00
401b064917 Add EE license 2025-08-18 16:23:02 +02:00