806 Commits

Author	SHA1	Message	Date
Louis Dureuil	15690b9e22	Merge branch 'main' into arroy-becomes-hannoy	2025-09-08 17:05:05 +02:00
Louis Dureuil	a8cd81c7f4	get_vector_store returns an option, handles it in Index::settings	2025-09-08 16:53:57 +02:00
Louis Dureuil	226c102bab	Update snapshot and upgrade proc	2025-09-08 10:00:44 +02:00
Louis Dureuil	13df964564	Adopt neutral terminology where arroy/hannoy would be confusing	2025-09-03 16:11:40 +02:00
Louis Dureuil	0faf495173	cargo fmt	2025-09-03 14:49:24 +02:00
Louis Dureuil	c32c74671d	Rename HannoyStats to VectorStoreStats ... The stats can be provided by any backend	2025-09-03 14:45:31 +02:00
Louis Dureuil	b05bcf2c13	happy clippy	2025-09-03 14:13:08 +02:00
Louis Dureuil	90cc5263f6	Remove MEILI_EMBEDDINGS_CHUNK_SIZE	2025-09-03 13:57:58 +02:00
Louis Dureuil	424d0e277e	Merge branch 'main' into arroy-becomes-hannoy-with-sharding	2025-09-03 13:46:35 +02:00
Louis Dureuil	687260bc13	Change approach to arroy <-> migration after encountering multiple issues	2025-09-02 17:49:22 +02:00
Louis Dureuil	6b6e69b07a	rename Arroy to "stable" and Hannoy to "experimental" in setting values	2025-09-02 14:52:43 +02:00
Louis Dureuil	a25111f32e	get old backend before it mutates	2025-09-02 14:52:18 +02:00
Louis Dureuil	454581dbc9	Support progress	2025-09-01 17:48:50 +02:00
Louis Dureuil	118c6da64d	Update hannoy to v0.0.5	2025-09-01 16:42:08 +02:00
Louis Dureuil	a989f52657	Fix signature of backend change function	2025-09-01 16:38:39 +02:00
Louis Dureuil	a8cc66899c	Derive ToSchema for VectorStoreBackend	2025-09-01 16:38:18 +02:00
Louis Dureuil	c9cc748f42	Mark get_vector_store as public	2025-09-01 16:37:52 +02:00
Louis Dureuil	8933d87031	Make backend change cancelable	2025-09-01 12:10:57 +02:00
Louis Dureuil	231f86decf	Refer to v1.19 and remove arroy -> hannoy dumpless upgrade	2025-09-01 12:10:13 +02:00
Louis Dureuil	381de52fc5	Add setting to change backend	2025-09-01 12:09:18 +02:00
Louis Dureuil	5fc7872ab3	Make sure the vector store works with both arroy and hannoy	2025-08-28 16:32:47 +02:00
Louis Dureuil	b2f2807a94	Integrate arroy with conversion capabilities	2025-08-28 14:43:04 +02:00
Louis Dureuil	da6fffdf6d	Switch from version to backend selector	2025-08-26 17:49:56 +02:00
Louis Dureuil	b5f0c19406	Split the vector module in submodules	2025-08-26 16:32:17 +02:00
Louis Dureuil	fb7ccc0db3	remove v1_17	2025-08-26 10:25:20 +02:00
Louis Dureuil	69a84fbfe6	update to v1.22	2025-08-26 10:25:19 +02:00
Clément Renault	31cb960992	Make clippy happy	2025-08-26 10:19:55 +02:00
Clément Renault	6d9e0c4bce	Switch to hannoy 0.0.4	2025-08-26 10:19:54 +02:00
Kerollmops	f4147a60a3	Remove the vector_store reference	2025-08-26 10:19:54 +02:00
Mubelotix	72c63d3929	Move code to the right file	2025-08-26 10:19:54 +02:00
Clément Renault	97ea9e9937	Make cargo fmt happy	2025-08-26 10:19:54 +02:00
Clément Renault	4645813ea8	Make clippy happy	2025-08-26 10:19:54 +02:00
Clément Renault	fb68f1241c	Dispatch the vector store based on the index version	2025-08-26 10:19:54 +02:00
Clément Renault	f5f2f7c6f2	Make the VectorStore aware of the index version	2025-08-26 10:19:53 +02:00
Clément Renault	6340412219	Expose Hannoy progress when upgrading	2025-08-26 10:19:53 +02:00
Louis Dureuil	6e4dfa0168	First version of Hannoy dumpless upgrade	2025-08-26 10:19:52 +02:00
Clément Renault	0d4b78a217	Integrate the hannoy progress	2025-08-26 09:44:23 +02:00
Kerollmops	aef07f4bfa	wip: Use Hamming when binary quantized	2025-08-26 09:44:23 +02:00
Clément Renault	0b3f983d27	Always use at least an ef = 100 when searching	2025-08-26 09:44:23 +02:00
Kerollmops	6d92c94bb3	Add a missing cancelation call for hannoy	2025-08-26 09:44:23 +02:00
Kerollmops	30110a0488	Reintroduce changing the distance from Cosine to Cosine binary quantized	2025-08-26 09:44:22 +02:00
Kerollmops	47cee7e1ea	Bump Hannoy's version	2025-08-26 09:44:22 +02:00
Clément Renault	493d67ffd4	Increase efSearch from x2 to x10	2025-08-26 09:44:22 +02:00
Clément Renault	2b2559016a	Increase efConstruction from 48 to 125	2025-08-26 09:44:22 +02:00
Clément Renault	6176b143bb	remove-me: Introduce an env var to change the embeddings chunk size	2025-08-26 09:44:22 +02:00
Clément Renault	27550dafad	Reintroduce arroy and support for dumpless upgrade from previous versions	2025-08-26 09:44:21 +02:00
Clément Renault	a7cd6853db	Rename the vector store const name and keep the vector-arroy db name	2025-08-26 09:44:21 +02:00
Clément Renault	f51f7832a7	Rename the ArroyWrapper/HannoyWrapper into VectorStore	2025-08-26 09:44:21 +02:00
Clément Renault	a38a57acb6	Use constants as the hannoy default parameters	2025-08-26 09:44:21 +02:00
Kerollmops	affcaef556	Use Hannoy instead of arroy	2025-08-26 09:44:21 +02:00