ManyTheFish
d99419acfb
Add a NoOp operation in index update
2025-05-12 14:19:15 +02:00
ManyTheFish
f349630e78
Add v1.15 in index-scheduler upgrade
2025-05-12 13:53:23 +02:00
ManyTheFish
0f4536df2d
Adapt dumpless upgrade tests
2025-05-12 10:43:12 +02:00
Louis Dureuil
f7c1f19dd8
rust fmt
2025-04-29 16:10:43 +02:00
Louis Dureuil
1542ff30ae
Roll back index scheduler version first
2025-04-29 16:05:43 +02:00
Louis Dureuil
20d0aa499a
Apply suggestions from code review
...
Co-authored-by: Clément Renault <clement@meilisearch.com >
2025-04-29 16:03:30 +02:00
Louis Dureuil
c5360bcdbf
When canceling an upgrade task, execute the rollback code
2025-04-24 16:59:03 +02:00
Louis Dureuil
1bdc08a73a
tick: always refuse to batch tasks when the version in the index-scheduler is wrong
2025-04-24 16:54:43 +02:00
Louis Dureuil
63b5e21ae1
tick: check tasks to cancel before checking for upgrade tasks
2025-04-24 16:52:28 +02:00
Louis Dureuil
eb0b5239cb
process rollback
2025-04-24 16:52:28 +02:00
Louis Dureuil
121c1ac1dd
Upgrade supports cancelling
2025-04-24 16:08:10 +02:00
Louis Dureuil
b82dda2d0d
Allow rollbacking indexes in the mapper
2025-04-24 16:08:10 +02:00
Louis Dureuil
ea9330e9c9
Add new errors when there is a version mismatch between the bin and index or index-scheduler
2025-04-24 16:08:10 +02:00
Louis Dureuil
b6a9d8d2ac
Add Error::RollbackFailed
2025-04-24 16:06:19 +02:00
Louis Dureuil
e1aa534389
Wait 10 seconds in case of irrecoverable error
2025-04-24 16:06:19 +02:00
Louis Dureuil
49add50cb3
Make version constants u32
2025-04-24 16:06:19 +02:00
Tamo
9fd9fcb03e
Merge pull request #5512 from DanasFi/task_queue_metrics
...
Task queue metrics
2025-04-17 09:38:25 +00:00
DanasFi
fd0623c085
Fix typo in function to get size until task queue stops
2025-04-17 10:48:56 +02:00
DanasFi
eeb33b913c
Corrected metric for task queue total size
2025-04-17 10:46:26 +02:00
DanasFi
3d93efc6aa
Added metric to check task queue size until stop
2025-04-17 10:46:25 +02:00
Tamo
e9b4794f2b
Merge pull request #5488 from meilisearch/try-batch-end-reason
...
add "batcher stopped because" field to batch objects
2025-04-17 08:26:31 +00:00
Louis Dureuil
b61eb19601
Fix snapshots
2025-04-15 15:13:53 +02:00
Louis Dureuil
231a027c7d
Use TaskKindCannotBeBatched for task deletion, upgrade database and snapshot creation
2025-04-15 15:13:53 +02:00
Louis Dureuil
b73660fa8e
Update crates/index-scheduler/src/scheduler/test_document_addition.rs
...
fix comment in test
Co-authored-by: Tamo <tamo@meilisearch.com >
2025-04-15 14:48:11 +02:00
Louis Dureuil
3a93f88ba6
Merge pull request #5498 from meilisearch/snapshot-no-compaction
...
Stop compacting the snapshot
2025-04-15 08:30:40 +00:00
Tamo
b025f1bcf1
Merge branch 'main' into release-v1.14.0-tmp
2025-04-14 12:35:47 +02:00
Louis Dureuil
9e7d7beb4a
stop compacting the snapshot
2025-04-08 14:53:58 +02:00
Tamo
796a325972
Fix typos
...
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-04-03 15:53:42 +02:00
Tamo
1db550ec7f
make meilisearch accept cancelation tasks even when the disk is full
2025-04-03 15:47:56 +02:00
Louis Dureuil
c1c065079f
Fix snapshots again
2025-04-03 10:51:57 +02:00
Louis Dureuil
1cca4abf5a
Replace batch stop reason when deleting index
2025-04-03 10:33:59 +02:00
Louis Dureuil
bd172bf68a
Fix more snapshots
2025-04-03 10:30:03 +02:00
Louis Dureuil
70ed6ba798
fix test + change name
2025-04-02 17:56:34 +02:00
Louis Dureuil
f3ab940776
Make it compile
2025-04-02 17:14:40 +02:00
Kerollmops
e067d796b3
Improve the primary key stop reasons error messages
2025-04-02 15:56:56 +02:00
Louis Dureuil
31bda976f2
WIP
2025-04-02 15:29:47 +02:00
Clément Renault
4d90e3d2ec
Make Cargo and Clippy happy
2025-04-01 11:26:34 +02:00
Kerollmops
7ed9adde29
Prefer camelCase for internal database sizes db name
2025-03-26 16:45:52 +01:00
Kerollmops
5820d822c8
Add more details about the finalizing progress step
2025-03-26 09:49:43 +01:00
Kerollmops
637bea0370
Compute and store the database sizes
2025-03-26 09:49:42 +01:00
meili-bors[bot]
2500e3c067
Merge #5414
...
5414: Update version for the next release (v1.14.0) in Cargo.toml r=Kerollmops a=meili-bot
⚠️ This PR is automatically generated. Check the new version is the expected one and Cargo.lock has been updated before merging. Fixes https://github.com/meilisearch/meilisearch/issues/5268 .
Co-authored-by: Kerollmops <Kerollmops@users.noreply.github.com >
Co-authored-by: Kerollmops <clement@meilisearch.com >
2025-03-14 13:35:54 +00:00
Kerollmops
2a47e25e6d
Update the upgrade path snap
2025-03-13 18:35:06 +01:00
Louis Dureuil
e2d372823a
Disable the cache by default and make it experimental
2025-03-13 17:22:51 +01:00
Louis Dureuil
d0b0b90d17
fixup tests, in particular foil the cache for the timeout test
2025-03-13 17:22:50 +01:00
Kerollmops
41d8161017
Update the versions
2025-03-13 17:22:32 +01:00
Kerollmops
5e6abcf50c
Prefer using WithoutTls for the auth env
2025-03-13 11:29:00 +01:00
Kerollmops
55ca2c4481
Avoid opening the Auth environment multiple times
2025-03-13 11:07:49 +01:00
Kerollmops
1d499ed9b2
Use the new arroy upgrade method to move from 0.4 to 0.5
2025-03-13 11:07:44 +01:00
Kerollmops
3bc62f0549
WIP: Still need to introduce a Env::copy_to_path method
2025-03-13 11:07:39 +01:00
meili-bors[bot]
a2a86ef4e2
Merge #5254
...
5254: Granular Filterable attribute settings r=ManyTheFish a=ManyTheFish
# Related
**Issue:** https://github.com/meilisearch/meilisearch/issues/5163
**PRD:** https://meilisearch.notion.site/API-usage-Settings-to-opt-out-indexing-features-filterableAttributes-1764b06b651f80aba8bdf359b2df3ca8
# Summary
Change the `filterableAttributes` settings to let the user choose which facet feature he wants to activate or not.
Deactivating a feature will avoid some database computation in the indexing process and save time and disk size.
# Example
`PATCH /indexes/:index_uid/settings`
```json
{
"filterableAttributes": [
{
"patterns": [
"cattos",
"doggos.age"
],
"features": {
"facetSearch": false,
"filter": {
"equality": true,
"comparison": false
}
}
}
]
}
```
# Impact on the codebase
- Settings API:
- `/settings`
- `/settings/filterable-attributes`
- OpenAPI
- may impact the LocalizedAttributesRules due to the AttributePatterns factorization
- Database:
- Filterable attributes format changed
- Faceted field_ids are no more stored in the database
- FieldIdsMap has no more unexisting fields
- Search:
- Search using filters
- Facet search
- `Attributes` ranking rule
- Distinct attribute
- Facet distribution
- Settings reindexing:
- searchable
- facet
- vector
- geo
- Document indexing:
- searchable
- facet
- vector
- geo
- Dump import
# Note for the reviewers
The changes are huge and have been split in different commits with a dedicated explanation, I suggest reviewing the commit 1by1
Co-authored-by: ManyTheFish <many@meilisearch.com >
2025-03-12 09:00:43 +00:00
