30 Commits

Author	SHA1	Message	Date
Clément Renault	a0bfcf8872	Make cargo fmt happy	2025-04-01 11:27:41 +02:00
Clément Renault	4d90e3d2ec	Make Cargo and Clippy happy	2025-04-01 11:26:34 +02:00
ManyTheFish	ae8d453868	Refactor Document indexing process (searchables) ... **Changes:** The searchable database extraction is now relying on the AttributePatterns and FieldIdMapWithMetadata to match the field to extract. Remove the SearchableExtractor trait to make the code less complex. **Impact:** - Document Addition/modification searchable indexing - Document deletion searchable indexing	2025-03-03 10:32:42 +01:00
Louis Dureuil	de7f8c4406	refactor indexer mod	2025-01-07 15:29:02 +01:00
Tamo	df9b68f8ed	inital implementation of the progress	2024-12-11 16:25:01 +01:00
Kerollmops	a751972c57	Prefer using a stable than a random hash builder	2024-12-10 14:25:53 +01:00
Kerollmops	89637bcaaf	Use bumparaw-collections in Meilisearch/milli	2024-12-10 11:52:20 +01:00
ManyTheFish	07f42e8057	Do not index a filed count when no word is counted	2024-12-09 15:45:12 +01:00
Louis Dureuil	bd5110a2fe	Fix clippy warnings	2024-12-05 16:13:07 +01:00
Louis Dureuil	2b74d1824b	Ignore documents that didn't change any field in word pair proximity	2024-12-05 15:56:22 +01:00
Louis Dureuil	c77b00d3ac	Don't extract word docids when no searchable changed	2024-12-05 15:51:58 +01:00
Clément Renault	5727e00374	Remove useless geo skipped	2024-11-21 16:47:08 +01:00
ManyTheFish	36962b943b	First batch of PR comment	2024-11-21 16:38:11 +01:00
ManyTheFish	4d616f8794	Parse every attributes and filter before tokenization	2024-11-20 15:15:25 +01:00
Louis Dureuil	2afa33011a	Fix tokenize_document	2024-11-20 13:16:43 +01:00
ManyTheFish	b1f8aec348	Fix index_documents_check_exists_database	2024-11-20 13:16:41 +01:00
ManyTheFish	ba7f091db3	Use tokenizer on numbers and booleans	2024-11-20 13:16:41 +01:00
Louis Dureuil	8049df125b	Add depth to facet extraction so that null inside an array doesn't mark the entire field as null	2024-11-20 13:16:40 +01:00
ManyTheFish	41dbdd2d18	Fix filtered_placeholder_search_should_not_return_deleted_documents and word_scale_set_and_reset	2024-11-19 16:08:25 +01:00
Louis Dureuil	c782c09208	Move step to a dedicated mod and replace it with an enum	2024-11-18 18:22:13 +01:00
Louis Dureuil	04c38220ca	Move MostlySend, ThreadLocal, FullySend to their own commit	2024-11-18 16:43:05 +01:00
Clément Renault	5b4c06c24c	Plug the grenad max memory parameter	2024-11-18 11:28:04 +01:00
ManyTheFish	4ff2b3c2ee	Fix test on locales	2024-11-14 15:45:04 +01:00
ManyTheFish	91c58cfa38	Fix positional databases	2024-11-14 11:40:12 +01:00
Clément Renault	8e5b1a3ec1	Compute the field distribution and convert _geo into an f64s	2024-11-13 17:44:05 +01:00
Clément Renault	b17896d899	Finialize the GeoExtractor	2024-11-13 17:43:02 +01:00
Clément Renault	0e4e9e866a	Move the RefCellExt trait in a dedicated module	2024-11-07 11:36:09 +01:00
Louis Dureuil	10f49f0d75	Post processing of the merge	2024-11-06 17:50:12 +01:00
Louis Dureuil	ee03743355	Merge branch 'indexer-edition-2024' into indexer-edition-2024-doc-chunks	2024-11-06 15:50:53 +01:00
ManyTheFish	10feeb88f2	Merge branch 'main' into indexer-edition-2024	2024-11-06 15:19:18 +01:00