Kerollmops
							
						 
					 | 
					
						
						
							
						
						fedb444e66
					 | 
					
						
						
							
							Fix the upgrade arroy calls
						
						
						
						
						
						
					 | 
					
						2025-03-13 11:07:49 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						1d499ed9b2
					 | 
					
						
						
							
							Use the new arroy upgrade method to move from 0.4 to 0.5
						
						
						
						
						
						
					 | 
					
						2025-03-13 11:07:44 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						3bc62f0549
					 | 
					
						
						
							
							WIP: Still need to introduce a Env::copy_to_path method
						
						
						
						
						
						
					 | 
					
						2025-03-13 11:07:39 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						803a699b15
					 | 
					
						
						
							
							Remove unsafes
						
						
						
						
						
						
					 | 
					
						2025-02-12 10:46:45 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						246ad3b06e
					 | 
					
						
						
							
							Display a progress percentage
						
						
						
						
						
						
					 | 
					
						2025-02-12 09:56:05 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						5dab435d13
					 | 
					
						
						
							
							Add more logs about read txns
						
						
						
						
						
						
					 | 
					
						2025-02-11 18:14:48 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						c83c1a3c51
					 | 
					
						
						
							
							Introduce the Hair Dryer meilitool sucommand
						
						
						
						
						
						
					 | 
					
						2025-02-11 18:01:53 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						fa00b42c93
					 | 
					
						
						
							
							fix the missing batch in the dumps in meilisearch and meilitools
						
						
						
						
						
						
					 | 
					
						2025-02-11 11:14:49 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						5f2a1a4fd1
					 | 
					
						
						
							
							Skip the documents before fetching them
						
						
						
						
						
						
					 | 
					
						2025-02-06 15:40:22 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						37092adc71
					 | 
					
						
						
							
							Show a bit of progress
						
						
						
						
						
						
					 | 
					
						2025-02-06 10:37:05 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						86fcad788e
					 | 
					
						
						
							
							Introduce a parameter to skip the first documents
						
						
						
						
						
						
					 | 
					
						2025-02-06 10:32:50 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						2ea5c57871
					 | 
					
						
						
							
							Create a new export documents meilitool subcommand based on v1.12
						
						
						
						
						
						
					 | 
					
						2025-02-06 10:32:39 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								meili-bors[bot]
							
						 
					 | 
					
						
						
							
						
						fe46855462
					 | 
					
						
						
							
							Merge #5235
						
						
						
						
						
						
						
						5235: Introduce a compaction subcommand in meilitool r=dureuill a=Kerollmops
This PR proposes a change to the meilitool helper, introducing the `compact-index` subcommand to reduce the size of the indexes.
While working on this tool, I discovered that the current heed `Env::copy_to_file` API is not very temp file friendly and [could be improved](https://github.com/meilisearch/heed/issues/306).
Co-authored-by: Kerollmops <clement@meilisearch.com>
Co-authored-by: Clément Renault <clement@meilisearch.com> 
						
						
					 | 
					
						2025-02-03 10:11:01 +00:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						8e7d2d25f2
					 | 
					
						
						
							
							Only open indexes, do not create them
						
						
						
						
						
						
					 | 
					
						2025-02-03 10:50:38 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						2385842537
					 | 
					
						
						
							
							Fix the imports
						
						
						
						
						
						
					 | 
					
						2025-02-03 10:29:09 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						62ced0e3f1
					 | 
					
						
						
							
							Make cargo fmt happy
						
						
						
						
						
						
					 | 
					
						2025-01-30 11:09:54 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Clément Renault
							
						 
					 | 
					
						
						
							
						
						71bb24f17e
					 | 
					
						
						
							
							Throw and error when the index is not found
						
						
						
						
						
						
						
						Co-authored-by: Louis Dureuil <louis@meilisearch.com> 
						
						
					 | 
					
						2025-01-30 11:07:43 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Clément Renault
							
						 
					 | 
					
						
						
							
						
						c72f114b33
					 | 
					
						
						
							
							Fix english in the comments
						
						
						
						
						
						
						
						Co-authored-by: Louis Dureuil <louis@meilisearch.com> 
						
						
					 | 
					
						2025-01-30 11:07:09 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						50280bf02b
					 | 
					
						
						
							
							Support offline upgrade up to v1.12.7
						
						
						
						
						
						
					 | 
					
						2025-01-24 12:25:33 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						86bf231d29
					 | 
					
						
						
							
							Change to meilitool after rebase
						
						
						
						
						
						
					 | 
					
						2025-01-23 16:59:32 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						7197ced673
					 | 
					
						
						
							
							fix the bad index version on opening
						
						
						
						
						
						
					 | 
					
						2025-01-23 16:51:24 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						102681e384
					 | 
					
						
						
							
							starts adding tests and fix the starts of meilisearch
						
						
						
						
						
						
					 | 
					
						2025-01-23 16:51:18 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Kerollmops
							
						 
					 | 
					
						
						
							
						
						e6295c9c5f
					 | 
					
						
						
							
							Introduce a meilitool subcommand to compact an index
						
						
						
						
						
						
					 | 
					
						2025-01-22 16:37:00 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						2e04ab4737
					 | 
					
						
						
							
							Replace guards by OR patterns
						
						
						
						
						
						
						
						Co-authored-by: Tamo <tamo@meilisearch.com> 
						
						
					 | 
					
						2025-01-22 15:50:42 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						d95384a636
					 | 
					
						
						
							
							Remove batch ids on export
						
						
						
						
						
						
					 | 
					
						2025-01-22 15:50:42 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						c0690f5b9e
					 | 
					
						
						
							
							Make offline upgrade more flexible
						
						
						
						
						
						
					 | 
					
						2025-01-22 15:50:42 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						909d84447d
					 | 
					
						
						
							
							meilitool dumps old-style dump for older DBs, otherwise new-style
						
						
						
						
						
						
					 | 
					
						2025-01-22 15:50:42 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								ManyTheFish
							
						 
					 | 
					
						
						
							
						
						a8006a3750
					 | 
					
						
						
							
							Change format of update file when importing dump
						
						
						
						
						
						
					 | 
					
						2025-01-22 15:50:41 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						0e0e462f5b
					 | 
					
						
						
							
							Also fix dump import from meilitool
						
						
						
						
						
						
					 | 
					
						2025-01-22 15:50:41 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						72ded27e98
					 | 
					
						
						
							
							Update after review
						
						
						
						
						
						
					 | 
					
						2025-01-14 10:24:50 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						c25781f720
					 | 
					
						
						
							
							Skip rebuilding field distribution if not coming from v1.12
						
						
						
						
						
						
					 | 
					
						2025-01-14 10:24:28 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						c3b18fede9
					 | 
					
						
						
							
							write stats after rebuilding facet distribution
						
						
						
						
						
						
					 | 
					
						2025-01-14 10:24:27 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						4070895a21
					 | 
					
						
						
							
							Add support to upgrade to v1.12.3 in meilitool
						
						
						
						
						
						
					 | 
					
						2025-01-14 10:24:27 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Clément Renault
							
						 
					 | 
					
						
						
							
						
						b997039a91
					 | 
					
						
						
							
							Upgrade compatible dependencies
						
						
						
						
						
						
					 | 
					
						2025-01-08 13:52:14 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						8cd3a1aa57
					 | 
					
						
						
							
							fmt
						
						
						
						
						
						
					 | 
					
						2024-12-11 18:18:40 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Many the fish
							
						 
					 | 
					
						
						
							
						
						5c492031d9
					 | 
					
						
						
							
							Update crates/meilitool/src/upgrade/v1_12.rs
						
						
						
						
						
						
						
						Co-authored-by: Louis Dureuil <louis@meilisearch.com> 
						
						
					 | 
					
						2024-12-11 14:34:18 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								ManyTheFish
							
						 
					 | 
					
						
						
							
						
						c614d0dd35
					 | 
					
						
						
							
							Add context when returning an error
						
						
						
						
						
						
					 | 
					
						2024-12-11 10:55:39 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								ManyTheFish
							
						 
					 | 
					
						
						
							
						
						479607e5dd
					 | 
					
						
						
							
							Convert update files from OBKV to ndjson
						
						
						
						
						
						
					 | 
					
						2024-12-11 10:55:39 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						6e6acfcf1b
					 | 
					
						
						
							
							Merge branch 'main' into indexer-edition-2024
						
						
						
						
						
						
					 | 
					
						2024-11-20 16:59:58 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						7e379b3d14
					 | 
					
						
						
							
							remove useless prints
						
						
						
						
						
						
					 | 
					
						2024-11-20 12:27:12 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Louis Dureuil
							
						 
					 | 
					
						
						
							
						
						10f49f0d75
					 | 
					
						
						
							
							Post processing of the merge
						
						
						
						
						
						
					 | 
					
						2024-11-06 17:50:12 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						7415ef7ff5
					 | 
					
						
						
							
							Update crates/meilitool/src/upgrade/v1_11.rs
						
						
						
						
						
						
						
						Co-authored-by: Louis Dureuil <louis@meilisearch.com> 
						
						
					 | 
					
						2024-11-05 15:37:59 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						a5d138ac34
					 | 
					
						
						
							
							use a tag while importing arroy instead of a loose branch or rev
						
						
						
						
						
						
					 | 
					
						2024-11-05 15:24:02 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						0f74a93346
					 | 
					
						
						
							
							Update crates/meilitool/src/upgrade/v1_11.rs
						
						
						
						
						
						
						
						Co-authored-by: Louis Dureuil <louis@meilisearch.com> 
						
						
					 | 
					
						2024-11-05 15:14:02 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						e4993aa705
					 | 
					
						
						
							
							Update crates/meilitool/src/upgrade/mod.rs
						
						
						
						
						
						
						
						Co-authored-by: Louis Dureuil <louis@meilisearch.com> 
						
						
					 | 
					
						2024-11-05 15:13:50 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						66b7e0824e
					 | 
					
						
						
							
							Update crates/meilitool/src/upgrade/mod.rs
						
						
						
						
						
						
						
						Co-authored-by: Louis Dureuil <louis@meilisearch.com> 
						
						
					 | 
					
						2024-11-05 15:13:40 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						f193c3a67c
					 | 
					
						
						
							
							Update crates/meilitool/src/main.rs
						
						
						
						
						
						
						
						Co-authored-by: Louis Dureuil <louis@meilisearch.com> 
						
						
					 | 
					
						2024-11-05 15:13:32 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						48ab898ca2
					 | 
					
						
						
							
							fix the datetime of v1.9
						
						
						
						
						
						
					 | 
					
						2024-11-05 10:30:53 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						99a9fde37f
					 | 
					
						
						
							
							push back the removed files
						
						
						
						
						
						
					 | 
					
						2024-11-04 17:55:55 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 | 
				
			
				
					
						
							
							
								 
								Tamo
							
						 
					 | 
					
						
						
							
						
						5f57306858
					 | 
					
						
						
							
							update the arroy version in meilitool
						
						
						
						
						
						
					 | 
					
						2024-11-04 17:47:10 +01:00 | 
					
					
						
						
						
							
							
							
							
							
							
							
							
						
					 |