Louis Dureuil
59631afd9a
Merge pull request #5929 from meilisearch/compaction-task
...
Introduce a task to compact an index
2025-10-09 11:30:01 +00:00
Louis Dureuil
685663af3c
bump cellulite to address backcompat issue from #5307
2025-10-09 10:20:58 +02:00
Louis Dureuil
72b4b41443
Read MEILI_EXPERIMENTAL_REMOTE_SEARCH_TIMEOUT_SECONDS to override the default timeout in remote federated search
2025-10-09 09:34:49 +02:00
Louis Dureuil
70aa768d48
Update ignored test
2025-10-09 09:34:48 +02:00
Louis Dureuil
6029677eec
Also raise the global deadline
2025-10-09 09:34:48 +02:00
Louis Dureuil
3c78f4121e
Raise timeout to 30secs
2025-10-09 09:34:48 +02:00
Many the fish
6379a62d95
Merge pull request #5933 from meilisearch/fix-ranking-score-with-sort
...
Fix ranking score bug when sort is present
2025-10-08 16:23:12 +00:00
ManyTheFish
ce832da16c
Add a function documentation
2025-10-08 17:19:40 +02:00
Louis Dureuil
14de657d36
Use the "currently_processing_index" to avoid potentially blocking the search during compaction
2025-10-08 15:45:38 +02:00
Kerollmops
9a36c090bf
Do not return the EnvClosingEvent
2025-10-08 15:38:45 +02:00
Kerollmops
3aca010b42
Recompute the stats
2025-10-08 15:33:12 +02:00
Clément Renault
62c11ce3f3
Fix comments
2025-10-08 15:33:12 +02:00
Clément Renault
f358538f4f
Improve the pre-compaction size information
2025-10-08 15:33:12 +02:00
Clément Renault
9068857ba1
Make the tests pass
2025-10-08 15:33:12 +02:00
Clément Renault
d241157084
Make Clippy happy
2025-10-08 15:33:12 +02:00
Clément Renault
69f73b1d74
Introduce a function to effectively close an index
2025-10-08 15:33:12 +02:00
Clément Renault
202794f620
Expose the env closing event so we can wait for the index to close
2025-10-08 15:33:12 +02:00
Kerollmops
38cbd54604
Implement the index compaction task
2025-10-08 15:33:12 +02:00
Kerollmops
3877e0043c
Rename operation to IndexCompaction
2025-10-08 15:33:12 +02:00
Clément Renault
f95398420b
Add the necessary batches and tasks in the process
2025-10-08 15:33:11 +02:00
Clément Renault
53905c1362
Add a new CompactIndex action
2025-10-08 15:33:11 +02:00
Clément Renault
113aac8815
Introduce a new /indexes/{indexUid}/compact route
2025-10-08 15:33:11 +02:00
ManyTheFish
d2071dde1f
Fix ranking score bug when sort is present
...
- Fix global_score function to properly handle semantic scores and ranking scores
- Prioritize semantic scores (vector/embedding) when available, fall back to ranking scores
- Exclude sort and geo sort details from relevance scoring
- Use Rank::global_score to properly merge ranking scores
- Add test case with insta snapshots to reproduce and verify the fix
- When sorting is present, ranking scores now properly reflect search relevance
- Previously all ranking scores were 1.0 when sort was present, now they show actual relevance scores
2025-10-08 11:23:43 +02:00
Many the fish
4502af5aed
Merge pull request #5930 from meilisearch/synonym-performance-fix
...
Synonym performance fix
2025-10-07 15:17:34 +00:00
ManyTheFish
06af68aa07
Get rid of upwrap in get_synonym, We can't use get_or_insert_with because the index.synonyms(..) returns a Result
2025-10-07 14:37:13 +02:00
ManyTheFish
6d378c6397
PERFORMANCE: Implement synonym caching to eliminate repeated database access
...
- Added SynonymCache to SearchContext to cache synonyms in memory
- Modified synonym retrieval to use cached synonyms after first load
- Eliminated redundant database calls for multi-word queries
- Performance improvement: 87% → 0ms for subsequent synonym processing
- Complex queries now process in 40ms vs 495ms (92% improvement)
2025-10-06 14:26:30 +02:00
Clément Renault
ec0c0cf779
Merge pull request #5307 from meilisearch/parallel-bulk-facets
...
Parallelize bulk facets & word prefix fid/position docids
2025-10-06 12:08:52 +00:00
Kerollmops
851694e323
Fix a bug where prefixes were never deleted
2025-10-03 10:50:05 +02:00
Kerollmops
ea92c64fdc
Fix a potential bug where prefixes were not deleted
2025-10-03 09:49:05 +02:00
Kerollmops
dc36f681be
Fix the prefix post-processing algorithm
2025-10-03 09:42:29 +02:00
Clément Renault
48f1987a8d
Improve facet post processing readability
...
Co-authored-by: Many the fish <many@meilisearch.com >
2025-10-03 09:42:29 +02:00
Clément Renault
9f79ce82af
Introduce new CLI arguments to deactivate experimental post processing
2025-10-02 12:06:33 +02:00
Clément Renault
5f18a9b2ee
Move dependencies to actual versions
2025-10-02 11:00:48 +02:00
Clément Renault
7f8a1ac0be
Remove useless heed path
2025-10-01 16:19:58 +02:00
Clément Renault
1a67163ee8
Use git cellulite in case
2025-10-01 16:02:07 +02:00
Clément Renault
38141de68d
Use local heed in case
2025-10-01 16:01:58 +02:00
Clément Renault
7a98b80687
Use temporary git repo for hannoy and arroy in nested-rtxns pre-version
2025-10-01 15:28:36 +02:00
Kerollmops
229a12c8e6
Multithread word prefix position docids
2025-10-01 15:18:21 +02:00
Kerollmops
2fdfe79400
Make clippy happy
2025-10-01 15:09:59 +02:00
Kerollmops
9184b12a26
Fix the algorithm
2025-10-01 15:09:59 +02:00
Kerollmops
742378d8e1
Multi-thread the facet bulk processing
2025-10-01 15:09:59 +02:00
ManyTheFish
f97384da6c
Fix geo_json snapshots
2025-09-30 17:03:21 +02:00
ManyTheFish
6ea76f2771
Add uuid v7 feature
2025-09-30 15:42:03 +02:00
ManyTheFish
715b255371
fix tests
2025-09-30 15:42:03 +02:00
ManyTheFish
db094d3923
Add requestUid field in search response and add debug logs with requestUid
2025-09-30 15:42:03 +02:00
Tamo
c50a337c29
bump version for 1.22.1
2025-09-25 13:44:44 +02:00
Tamo
efeae09ce1
Merge pull request #5906 from meilisearch/task-deletion-strategy
...
Delete oldest tasks first
2025-09-25 10:11:33 +00:00
Tamo
94eabd34e6
fmt
2025-09-25 11:01:53 +02:00
Tamo
6935589f74
use the latest version of zerometry that supports collection, lines and multi-lines
2025-09-25 10:31:07 +02:00
Louis Dureuil
4beb452027
Optimize by using from_sorted_iter
...
Co-authored-by: Tamo <tamo@meilisearch.com >
2025-09-25 10:16:30 +02:00
