38 Commits

Author	SHA1	Message	Date
Clément Renault	f9b77b35f0	Improve the pre-compaction size information	2025-10-07 15:25:10 +02:00
Kerollmops	8fb8f389ae	Implement the index compaction task	2025-10-07 14:33:54 +02:00
Kerollmops	fbe6e0b2df	Rename operation to IndexCompaction	2025-10-06 16:19:04 +02:00
Clément Renault	4a84f1cd1a	Add the necessary batches and tasks in the process	2025-10-02 17:17:32 +02:00
Clément Renault	f5f2f7c6f2	Make the VectorStore aware of the index version	2025-08-26 10:19:53 +02:00
Tamo	2bab375001	update the task details again	2025-08-13 09:54:32 +02:00
Tamo	4068c58417	change the details of the tasks	2025-08-13 09:51:49 +02:00
Tamo	a904ce109a	fix error code and add a bunch of tests for the swap and index rename	2025-08-13 09:48:39 +02:00
Tamo	ecea247e5d	Provide a rename argument to the swap	2025-08-13 09:48:39 +02:00
Tamo	ae5bd9d0e3	fix: updated_at was not 'updated' when updating the index name	2025-08-13 09:48:39 +02:00
Quentin de Quelen	ae2d0a67a4	Enhance index update functionality to support renaming by adding new_uid field. Update related structures and methods to handle the new index UID during updates, ensuring backward compatibility with existing index operations.	2025-08-13 09:48:39 +02:00
Quentin de Quelen	0f1c78b185	Add index rename feature	2025-08-13 09:48:39 +02:00
Mubelotix	8fef48f8ca	Merge pull request #5670 from meilisearch/export-and-transfer-route ... Introduce a new route to export indexes	2025-07-01 14:37:02 +00:00
Clément Renault	ad03c86c44	Display an accurate number of uploaded documents	2025-06-30 18:46:47 +02:00
ManyTheFish	6db5939f84	Re-integrate embedder stats	2025-06-30 09:52:06 +02:00
ManyTheFish	82fe80b360	Replace the legacy Settings::execute by the new one	2025-06-26 18:14:14 +02:00
Kerollmops	63031219c5	Add the payload size to the parameters	2025-06-26 13:57:32 +02:00
Clément Renault	e023ee4b6b	Working first implementation	2025-06-25 15:26:47 +02:00
Clément Renault	e74c3b692a	Introduce a new route to export documents and enqueue the export task	2025-06-25 15:26:46 +02:00
Mubelotix	d7721fe607	Format	2025-06-24 12:20:22 +02:00
Mubelotix	2f82d94502	Fix the test and simplify types	2025-06-23 18:55:23 +02:00
Mubelotix	4925b30196	Move embedder stats out of progress	2025-06-23 15:24:14 +02:00
Mubelotix	4cadc8113b	Add embedder stats in batches	2025-06-20 12:42:22 +02:00
Louis Dureuil	20d0aa499a	Apply suggestions from code review ... Co-authored-by: Clément Renault <clement@meilisearch.com>	2025-04-29 16:03:30 +02:00
Louis Dureuil	c5360bcdbf	When canceling an upgrade task, execute the rollback code	2025-04-24 16:59:03 +02:00
Kerollmops	5820d822c8	Add more details about the finalizing progress step	2025-03-26 09:49:43 +01:00
Kerollmops	637bea0370	Compute and store the database sizes	2025-03-26 09:49:42 +01:00
Kerollmops	05cc8c650c	Expose the write channel congestion in the batches	2025-02-19 15:47:54 +01:00
Tamo	8439aeb7cf	improve error message in case of unexpected panic while processing tasks	2025-01-29 11:51:06 +01:00
Tamo	ef47a0d820	apply review comment	2025-01-28 16:53:50 +01:00
Tamo	58f90b70c7	store the enqueued at to eases the batch deletion	2025-01-28 16:53:50 +01:00
Kerollmops	f21ae1f5d1	Remove the batch id from the date time databases	2025-01-28 16:53:50 +01:00
Tamo	c27c923439	introduce a trait to upgrade the indexes	2025-01-23 16:51:23 +01:00
Tamo	7740997ea8	reintroduce the unrecoverable error and use it where its supposed to be used	2025-01-23 16:51:22 +01:00
Tamo	5458850d21	write a test ensuring the index-scheduler is effectively down when the upgrade task fail and try to process it when it restarts. There is a bug when deleting this task	2025-01-23 16:51:19 +01:00
Tamo	3ef7a478cd	move the version check to the task queue	2025-01-23 16:48:32 +01:00
Tamo	d3654906bf	Add the new tasks with most of the job done	2025-01-23 16:48:32 +01:00
Tamo	cb82b0798a	Split the index-scheduler in ~500 loc modules	2025-01-06 14:08:26 +01:00