2138 Commits

Author	SHA1	Message	Date
Kerollmops	fbe56822f0	Disable compression entirely to avoid being CPU bound	2025-10-23 13:32:32 +02:00
Clément Renault	5e1af30b42	Improve the way we create the snapshot path	2025-10-20 16:48:14 +02:00
Clément Renault	d298b21a95	Remove useless dependencies	2025-10-20 16:48:14 +02:00
Kerollmops	a4ad87febf	Make it finaly work but without async on the write side	2025-10-20 16:48:14 +02:00
Kerollmops	2caa2be441	Seeking the tasks/data.mdb file to the begining made the trick	2025-10-20 16:48:14 +02:00
Kerollmops	a829ded023	Improve understanding of S3-related errors	2025-10-20 16:48:14 +02:00
Kerollmops	98be43b66b	Retrieve the bytesMut only when released	2025-10-20 16:48:14 +02:00
Kerollmops	3ec4750426	Fix minimum part size	2025-10-20 16:48:14 +02:00
Kerollmops	d717ec3486	Improve error messaging when missing env var	2025-10-20 16:48:14 +02:00
Clément Renault	0c06bdefac	WIP	2025-10-20 16:48:13 +02:00
Kerollmops	62a8133bcd	WIP Do more tests	2025-10-20 16:48:13 +02:00
Clément Renault	c1f7542dfa	WIP sending multiparts of 250MiB	2025-10-20 16:48:13 +02:00
Clément Renault	9105e8bb8c	Rename the update_path function	2025-10-20 16:48:13 +02:00
Clément Renault	59e2394e69	Geenrate an async tarball	2025-10-20 16:48:13 +02:00
Kerollmops	430bc91c4c	WIP	2025-10-20 16:48:13 +02:00
Kerollmops	1172dce093	Make max in flights parts fro upload configurable	2025-10-20 16:48:13 +02:00
Kerollmops	21140a33e6	Use a good mem advice for uploads	2025-10-20 16:48:13 +02:00
Kerollmops	9ed7a81495	Move the S3 snapshots to disk into a dedicated method	2025-10-20 16:48:13 +02:00
Clément Renault	c8c1d95efd	Upload ten parts at a time	2025-10-20 16:48:13 +02:00
Clément Renault	10d1e26478	Use the Bytes crate to send the parts	2025-10-20 16:48:13 +02:00
Clément Renault	cd781d267b	Upload indexes under their uuids	2025-10-20 16:48:13 +02:00
Clément Renault	b16af4a763	Initial working S3 uploads to RustFS	2025-10-20 16:48:13 +02:00
Louis Dureuil	1514d13ab3	Pass tokio handle to index-scheduler	2025-10-20 16:48:13 +02:00
Kerollmops	d51f13a59e	Use the latest version of heed	2025-10-20 16:48:13 +02:00
Clément Renault	a63762737c	Upgrade index scheduler	2025-10-20 12:22:27 +02:00
Clément Renault	77394bd4b9	Update insta tests	2025-10-20 10:54:16 +02:00
Clément Renault	cb87201c8b	Fix dumpless upgrade and do nothing	2025-10-20 10:42:35 +02:00
Clément Renault	34233efb63	Merge pull request #5946 from meilisearch/fix-compaction-issues ... Improve compaction behaviors	2025-10-16 15:42:38 +00:00
Clément Renault	af0608ebd6	Continue to the next index if index doesn't exists	2025-10-16 16:39:51 +02:00
Clément Renault	8c7e5c094e	Improve the task batch stopped message	2025-10-16 16:39:50 +02:00
Clément Renault	c064737137	Remove duplicated logic in auto batching of tasks	2025-10-16 16:33:20 +02:00
Clément Renault	1d188a7ad3	Make the compaction tasks a priority over the export ones	2025-10-16 13:01:23 +02:00
Louis Dureuil	326652a399	Update hannoy	2025-10-16 10:34:54 +02:00
Louis Dureuil	59316e8d5a	add unit test	2025-10-16 10:34:20 +02:00
Louis Dureuil	76d7f20c87	fix snap	2025-10-16 10:34:19 +02:00
Louis Dureuil	380b2797a5	Share the same budget for all queries of a given index in federated search	2025-10-16 10:34:19 +02:00
Kerollmops	ddc76ad0dc	Delete the leftover compaction files from canceled operations	2025-10-15 16:49:25 +02:00
Kerollmops	ffacf1c002	Introduce the new IndexMapper index path method	2025-10-15 16:49:25 +02:00
Kerollmops	5a49b93b77	Use constant tempfile name to reuse tempfile	2025-10-15 16:49:25 +02:00
Louis Dureuil	918a6eaec9	Implement for vector store ranking rule	2025-10-15 16:31:47 +02:00
Louis Dureuil	1e6ce70e3e	"Uninteresting" ranking rule implementations	2025-10-15 16:31:47 +02:00
Louis Dureuil	b418054ee4	Change bucket_sort logic to pass the time budget and allow for retrieving non-blocking buckets	2025-10-15 16:31:47 +02:00
Louis Dureuil	58f30e9d8a	Change RankingRule trait to account for budget	2025-10-15 16:31:46 +02:00
ManyTheFish	22d529523a	refactor: extract query metadata building logic into separate function	2025-10-14 14:39:07 +02:00
ManyTheFish	ed6f479940	Remove irrelevant test index method	2025-10-14 12:10:17 +02:00
ManyTheFish	f19f712433	Add local remote name when a remote federated search is made	2025-10-14 12:10:17 +02:00
ManyTheFish	24a92c2809	move contant header in search/mod.rs	2025-10-14 12:10:17 +02:00
ManyTheFish	443cc24408	--amend	2025-10-14 12:10:17 +02:00
ManyTheFish	e8d5228250	factorize metadata header	2025-10-14 12:10:17 +02:00
ManyTheFish	5c33fb090c	avoid openning each index twice and remove clones	2025-10-14 12:10:17 +02:00