Clément Renault 
							
						 
					 
					
						
						
							
						
						0409a26cd8 
					 
					
						
						
							
							Replace the concurrent vec by a linked list  
						
						
						
						
							
						
					 
					
						2024-10-03 15:15:29 +02:00 
						 
				 
			
				
					
						
							
							
								F. Levi 
							
						 
					 
					
						
						
							
						
						8221c94e7f 
					 
					
						
						
							
							Split into multiple files, refactor  
						
						
						
						
							
						
					 
					
						2024-10-03 15:37:51 +03:00 
						 
				 
			
				
					
						
							
							
								ManyTheFish 
							
						 
					 
					
						
						
							
						
						35f78b5423 
					 
					
						
						
							
							TO REMOVE: usefull debug prints  
						
						
						
						
							
						
					 
					
						2024-10-03 11:13:01 +02:00 
						 
				 
			
				
					
						
							
							
								ManyTheFish 
							
						 
					 
					
						
						
							
						
						14261f8f04 
					 
					
						
						
							
							Integrate facet level bulk update  
						
						... 
						
						
						
						Only the facet bulk update has been added so far, the incremental must be completely rewritten
Factorize facet merging
Fix facet level extraction 
						
						
							
						
					 
					
						2024-10-03 11:13:00 +02:00 
						 
				 
			
				
					
						
							
							
								ManyTheFish 
							
						 
					 
					
						
						
							
						
						774ed28539 
					 
					
						
						
							
							Fix Prefix FST when a document is modified  
						
						
						
						
							
						
					 
					
						2024-10-03 11:12:26 +02:00 
						 
				 
			
				
					
						
							
							
								ManyTheFish 
							
						 
					 
					
						
						
							
						
						d79f75f630 
					 
					
						
						
							
							Compute and Write external-documents-ids database  
						
						
						
						
							
						
					 
					
						2024-10-03 11:11:56 +02:00 
						 
				 
			
				
					
						
							
							
								F. Levi 
							
						 
					 
					
						
						
							
						
						c427d9e2ad 
					 
					
						
						
							
							Merge branch 'main' into change-matches-position-phrase-search  
						
						
						
						
							
						
					 
					
						2024-10-03 10:42:34 +03:00 
						 
				 
			
				
					
						
							
							
								F. Levi 
							
						 
					 
					
						
						
							
						
						40336ce87d 
					 
					
						
						
							
							Fix and refactor crop_bounds  
						
						
						
						
							
						
					 
					
						2024-10-03 10:40:14 +03:00 
						 
				 
			
				
					
						
							
							
								Timon Jurschitsch 
							
						 
					 
					
						
						
							
						
						2a18917af3 
					 
					
						
						
							
							add delete_index_fail function  
						
						
						
						
							
						
					 
					
						2024-10-02 16:23:21 +02:00 
						 
				 
			
				
					
						
							
							
								Clément Renault 
							
						 
					 
					
						
						
							
						
						ccf01c2471 
					 
					
						
						
							
							Merge pull request  #4969  from meilisearch/indexer-edition-2024-try-map  
						
						... 
						
						
						
						Indexer edition 2024 try map 
						
						
							
						
					 
					
						2024-10-02 11:25:05 +02:00 
						 
				 
			
				
					
						
							
							
								meili-bors[bot] 
							
						 
					 
					
						
						
							
						
						0566f2549d 
					 
					
						
						
							
							Merge  #4972  
						
						... 
						
						
						
						4972: Add binary quantized to error messages r=irevoire a=dureuill
was missing in error messages
Co-authored-by: Louis Dureuil <louis@meilisearch.com > 
						
						
							
 
						
					 
					
						2024-10-02 09:23:55 +00:00 
						 
				 
			
				
					
						
							
							
								Louis Dureuil 
							
						 
					 
					
						
						
							
						
						0c2661ea90 
					 
					
						
						
							
							Fix tests  
						
						
						
						
							
						
					 
					
						2024-10-02 11:20:29 +02:00 
						 
				 
			
				
					
						
							
							
								Louis Dureuil 
							
						 
					 
					
						
						
							
						
						62dfbd6255 
					 
					
						
						
							
							Add binary quantized to allowed fields for source adds its sources  
						
						
						
						
							
						
					 
					
						2024-10-02 11:20:02 +02:00 
						 
				 
			
				
					
						
							
							
								meili-bors[bot] 
							
						 
					 
					
						
						
							
						
						cc669f90d5 
					 
					
						
						
							
							Merge  #4971  
						
						... 
						
						
						
						4971: update arroy r=dureuill a=irevoire
# Pull Request
Fix part of https://github.com/meilisearch/meilisearch/issues/3715 
## What does this PR do?
- Update arroy to the latest version, most change are maintenance changes
- The performances of adding vectors to arroy should slightly improve
- Forward the build cancellation function to arroy so it can stop building trees when we have to stop an indexing process
Co-authored-by: Tamo <tamo@meilisearch.com > 
						
						
							
						
					 
					
						2024-10-02 05:53:51 +00:00 
						 
				 
			
				
					
						
							
							
								F. Levi 
							
						 
					 
					
						
						
							
						
						37a9d64c44 
					 
					
						
						
							
							Fix failing test, refactor  
						
						
						
						
							
						
					 
					
						2024-10-01 22:52:01 +03:00 
						 
				 
			
				
					
						
							
							
								Tamo 
							
						 
					 
					
						
						
							
						
						b1dc10e771 
					 
					
						
						
							
							uses the new cancellation method in arroy  
						
						
						
						
							
						
					 
					
						2024-10-01 17:45:49 +02:00 
						 
				 
			
				
					
						
							
							
								Tamo 
							
						 
					 
					
						
						
							
						
						4b598fa648 
					 
					
						
						
							
							update arroy  
						
						
						
						
							
						
					 
					
						2024-10-01 17:31:12 +02:00 
						 
				 
			
				
					
						
							
							
								Timon Jurschitsch 
							
						 
					 
					
						
						
							
						
						17571805b4 
					 
					
						
						
							
							use shared servers  
						
						
						
						
							
						
					 
					
						2024-10-01 17:27:27 +02:00 
						 
				 
			
				
					
						
							
							
								Timon Jurschitsch 
							
						 
					 
					
						
						
							
						
						2654ce6e6c 
					 
					
						
						
							
							use shared servers  
						
						
						
						
							
						
					 
					
						2024-10-01 17:01:47 +02:00 
						 
				 
			
				
					
						
							
							
								F. Levi 
							
						 
					 
					
						
						
							
						
						d9e4db9983 
					 
					
						
						
							
							Refactor  
						
						
						
						
							
						
					 
					
						2024-10-01 17:50:59 +03:00 
						 
				 
			
				
					
						
							
							
								F. Levi 
							
						 
					 
					
						
						
							
						
						6d16230f17 
					 
					
						
						
							
							Refactor  
						
						
						
						
							
						
					 
					
						2024-10-01 17:19:15 +03:00 
						 
				 
			
				
					
						
							
							
								Clément Renault 
							
						 
					 
					
						
						
							
						
						b7a5ba100e 
					 
					
						
						
							
							Move the ParallelIteratorExt into the parallel_iterator_ext module  
						
						
						
						
							
						
					 
					
						2024-10-01 11:11:52 +02:00 
						 
				 
			
				
					
						
							
							
								Clément Renault 
							
						 
					 
					
						
						
							
						
						dead7a56a3 
					 
					
						
						
							
							Keep the caches in the AppendOnlyVec  
						
						
						
						
							
						
					 
					
						2024-10-01 11:11:39 +02:00 
						 
				 
			
				
					
						
							
							
								Clément Renault 
							
						 
					 
					
						
						
							
						
						0a8cb471df 
					 
					
						
						
							
							Introduce the AppendOnlyVec struct for the parallel computing  
						
						
						
						
							
						
					 
					
						2024-10-01 11:11:25 +02:00 
						 
				 
			
				
					
						
							
							
								Clément Renault 
							
						 
					 
					
						
						
							
						
						00e045b249 
					 
					
						
						
							
							Rename and use the try_arc_for_each_try_init method  
						
						
						
						
							
						
					 
					
						2024-10-01 11:11:25 +02:00 
						 
				 
			
				
					
						
							
							
								Clément Renault 
							
						 
					 
					
						
						
							
						
						d83c9a4074 
					 
					
						
						
							
							Introduce the try_for_each_try_init method to be used with Arced Errors  
						
						
						
						
							
						
					 
					
						2024-10-01 11:11:25 +02:00 
						 
				 
			
				
					
						
							
							
								Clément Renault 
							
						 
					 
					
						
						
							
						
						f3356ddaa4 
					 
					
						
						
							
							Fix the errors when using the try_map_try_init method  
						
						
						
						
							
						
					 
					
						2024-10-01 11:11:10 +02:00 
						 
				 
			
				
					
						
							
							
								Clément Renault 
							
						 
					 
					
						
						
							
						
						31de5c747e 
					 
					
						
						
							
							WIP using try_map_try_init  
						
						
						
						
							
						
					 
					
						2024-10-01 11:10:53 +02:00 
						 
				 
			
				
					
						
							
							
								Clément Renault 
							
						 
					 
					
						
						
							
						
						3843240940 
					 
					
						
						
							
							Prefer using Ars instead of Options  
						
						
						
						
							
						
					 
					
						2024-10-01 11:10:53 +02:00 
						 
				 
			
				
					
						
							
							
								Louis Dureuil 
							
						 
					 
					
						
						
							
						
						8cb5e7437d 
					 
					
						
						
							
							try using try_map_try_init  
						
						
						
						
							
						
					 
					
						2024-10-01 11:10:53 +02:00 
						 
				 
			
				
					
						
							
							
								Louis Dureuil 
							
						 
					 
					
						
						
							
						
						5b776556fe 
					 
					
						
						
							
							Add ParallelIteratorExt  
						
						
						
						
							
						
					 
					
						2024-10-01 11:10:53 +02:00 
						 
				 
			
				
					
						
							
							
								ManyTheFish 
							
						 
					 
					
						
						
							
						
						bb7a503e5d 
					 
					
						
						
							
							Compute prefix databases  
						
						... 
						
						
						
						We are now computing the prefix FST and a prefix delta in the Merger thread,
after all the databases are written, the main thread will recompute the prefix databases based on the prefix delta without needing any grenad temporary file anymore 
						
						
							
						
					 
					
						2024-10-01 09:57:06 +02:00 
						 
				 
			
				
					
						
							
							
								F. Levi 
							
						 
					 
					
						
						
							
						
						eabc14c268 
					 
					
						
						
							
							Refactor, handle more cases for phrases  
						
						
						
						
							
						
					 
					
						2024-09-30 21:24:41 +03:00 
						 
				 
			
				
					
						
							
							
								meili-bors[bot] 
							
						 
					 
					
						
						
							
						
						e78da35287 
					 
					
						
						
							
							Merge  #4930  
						
						... 
						
						
						
						4930: Return `UserError::InvalidDocumentId` for primary keys with a length greater than 512 bytes r=curquiza a=flevi29
# Pull Request
## Related issue
Fixes  #4843 
## PR checklist
Please check if your PR fulfills the following requirements:
- [x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)?
- [x] Have you read the contributing guidelines?
- [x] Have you made sure that the title is accurate and descriptive of the changes?
Thank you so much for contributing to Meilisearch!
Co-authored-by: F. Levi <55688616+flevi29@users.noreply.github.com > 
						
						
							
						
					 
					
						2024-09-30 15:55:05 +00:00 
						 
				 
			
				
					
						
							
							
								Louis Dureuil 
							
						 
					 
					
						
						
							
						
						64589278ac 
					 
					
						
						
							
							Appease *some* of clippy warnings  
						
						
						
						
							
						
					 
					
						2024-09-30 16:08:29 +02:00 
						 
				 
			
				
					
						
							
							
								ManyTheFish 
							
						 
					 
					
						
						
							
						
						8df6daf308 
					 
					
						
						
							
							Remove fid_wordcount_docids.rs  
						
						
						
						
							
						
					 
					
						2024-09-30 11:52:31 +02:00 
						 
				 
			
				
					
						
							
							
								ManyTheFish 
							
						 
					 
					
						
						
							
						
						5b552caf42 
					 
					
						
						
							
							Fix position in insertions  
						
						
						
						
							
						
					 
					
						2024-09-30 11:46:32 +02:00 
						 
				 
			
				
					
						
							
							
								ManyTheFish 
							
						 
					 
					
						
						
							
						
						2b51a63418 
					 
					
						
						
							
							Remove dead code  
						
						
						
						
							
						
					 
					
						2024-09-30 11:42:36 +02:00 
						 
				 
			
				
					
						
							
							
								Louis Dureuil 
							
						 
					 
					
						
						
							
						
						3d8024fb2b 
					 
					
						
						
							
							write the weighted fields ids map  
						
						
						
						
							
						
					 
					
						2024-09-30 11:35:03 +02:00 
						 
				 
			
				
					
						
							
							
								Louis Dureuil 
							
						 
					 
					
						
						
							
						
						4b0da0ff24 
					 
					
						
						
							
							Fix inversion of field_id and position  
						
						
						
						
							
						
					 
					
						2024-09-30 11:34:50 +02:00 
						 
				 
			
				
					
						
							
							
								Louis Dureuil 
							
						 
					 
					
						
						
							
						
						079f2b5de0 
					 
					
						
						
							
							Format error messages consistently  
						
						
						
						
							
						
					 
					
						2024-09-30 11:34:31 +02:00 
						 
				 
			
				
					
						
							
							
								Timon Jurschitsch 
							
						 
					 
					
						
						
							
						
						84b4219a4f 
					 
					
						
						
							
							test: improve delete_index.rs  
						
						
						
						
							
						
					 
					
						2024-09-29 10:16:31 +02:00 
						 
				 
			
				
					
						
							
							
								Timon Jurschitsch 
							
						 
					 
					
						
						
							
						
						5539a1904a 
					 
					
						
						
							
							test: improve performance of create_index.rs  
						
						
						
						
							
						
					 
					
						2024-09-28 11:05:52 +02:00 
						 
				 
			
				
					
						
							
							
								F. Levi 
							
						 
					 
					
						
						
							
						
						00ccf53ffa 
					 
					
						
						
							
							Merge branch 'main' into change-matches-position-phrase-search  
						
						
						
						
							
						
					 
					
						2024-09-27 15:52:05 +03:00 
						 
				 
			
				
					
						
							
							
								F. Levi 
							
						 
					 
					
						
						
							
						
						d20a39b959 
					 
					
						
						
							
							Refactor find_best_match_interval  
						
						
						
						
							
						
					 
					
						2024-09-27 15:44:30 +03:00 
						 
				 
			
				
					
						
							
							
								meili-bors[bot] 
							
						 
					 
					
						
						
							
						
						71b364286b 
					 
					
						
						
							
							Merge  #4957  
						
						... 
						
						
						
						4957: Update charabia feature flags r=dureuill a=ManyTheFish
# Pull Request
Add charabia's `turkish` feature flag into Meilisearch default tokenization flag
[All tests pipeline](https://github.com/meilisearch/meilisearch/actions/runs/11030036031 )
Co-authored-by: ManyTheFish <many@meilisearch.com > 
						
						
							
						
					 
					
						2024-09-26 20:19:21 +00:00 
						 
				 
			
				
					
						
							
							
								meili-bors[bot] 
							
						 
					 
					
						
						
							
						
						86183e0807 
					 
					
						
						
							
							Merge  #4960  
						
						... 
						
						
						
						4960: Update rhai r=dureuill a=irevoire
# Pull Request
## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/4956 
A fix has been implemented in https://github.com/rhaiscript/rhai/issues/916 
## What does this PR do?
- Use the latest version of rhai containing the fix
Co-authored-by: Tamo <tamo@meilisearch.com > 
						
						
							
						
					 
					
						2024-09-26 15:03:01 +00:00 
						 
				 
			
				
					
						
							
							
								Tamo 
							
						 
					 
					
						
						
							
						
						78a4b7949d 
					 
					
						
						
							
							update rhai to a version that shouldn’t panic  
						
						
						
						
							
						
					 
					
						2024-09-26 15:04:03 +02:00 
						 
				 
			
				
					
						
							
							
								ManyTheFish 
							
						 
					 
					
						
						
							
						
						960060ebdf 
					 
					
						
						
							
							Fix fst builder when their is no previous FST  
						
						
						
						
							
						
					 
					
						2024-09-25 16:53:00 +02:00 
						 
				 
			
				
					
						
							
							
								Clément Renault 
							
						 
					 
					
						
						
							
						
						3d244451df 
					 
					
						
						
							
							Reduce the lru key size from 8 to 12 bytes  
						
						
						
						
							
						
					 
					
						2024-09-25 16:14:13 +02:00