38e1c40f38
meilisearch: logs route disconnects in profile mode
2024-02-08 15:03:33 +01:00
afc0585c1c
meilisearch: don't spawn a report everytime Meilisearch starts
2024-02-08 15:03:33 +01:00
ce6e6ec2c5
stops profiling in a file by default
2024-02-08 15:03:32 +01:00
91a8f74763
Add cancel log route
2024-02-08 15:03:32 +01:00
abaa72e2bf
start handling reloads with profiling
2024-02-08 15:03:32 +01:00
3c3a258a22
start exposing the profiling layer
2024-02-08 15:03:32 +01:00
73e66d5a97
Add dummy log when calling tasks
2024-02-08 15:03:32 +01:00
b8da117b9c
Simplify stream implementation
2024-02-08 15:03:32 +01:00
5e52107474
better than before???
2024-02-08 15:03:32 +01:00
bcf1c4dae5
make it compile and runtime error
2024-02-08 15:03:32 +01:00
50f84d43f5
init commit
2024-02-08 15:03:32 +01:00
f76cc0806e
WIP: first draft at introducing a new log route
2024-02-08 15:03:32 +01:00
6e23040464
Use with tokio channel in Meilisearch
2024-02-08 15:03:32 +01:00
83fb2949c3
Give the allocator to the tracer when necessary
2024-02-08 15:03:31 +01:00
771861599b
Logging the memory usage over time
2024-02-08 15:03:31 +01:00
7e47cea0c4
Add tracing to Meilisearch
2024-02-08 15:03:31 +01:00
05edd85d75
Stabilize scoreDetails
2024-02-06 11:15:19 +01:00
406531c991
Fix sysinfo
2024-01-16 16:49:51 +01:00
5e0268d40e
Fix the sysinfo errors
2024-01-16 15:43:03 +01:00
e93d36d5b9
Merge #4313
...
4313: Fix document formatting performances r=Kerollmops a=ManyTheFish
reduce the formatted option list to the attributes that should be formatted,
instead of all the attributes to display.
The time to compute the `format` list scales with the number of fields to format;
cumulated with `map_leaf_values` that iterates over all the nested fields, it gives a quadratic complexity:
`d*f` where `d` is the total number of fields to display and `f` is the total number of fields to format.
Co-authored-by: ManyTheFish <many@meilisearch.com >
2024-01-11 14:19:44 +00:00
95f8e21533
fix typos
2024-01-11 15:07:08 +01:00
b79b03d4e2
Fix proximity precision telemetry
2024-01-11 13:24:26 +01:00
86270e6878
Transform fields contained into _format into strings
2024-01-11 12:44:56 +01:00
5f5a486895
Reduce formatting time
2024-01-11 11:36:41 +01:00
3f3462ab62
Limit the number of values returned by the facet search
2024-01-10 16:54:08 +01:00
658ec6e0a4
Merge #4279
...
4279: Check experimental feature on setting update query rather than in the task. r=ManyTheFish a=dureuill
Improve the UX by checking for the vector store feature and returning an error synchronously when sending a setting update, rather than in the indexing task.
Co-authored-by: Louis Dureuil <louis@meilisearch.com >
2023-12-22 11:36:12 +00:00
43e822e802
Merge #4238
...
4238: Task queue webhook r=dureuill a=irevoire
# Prototype `prototype-task-queue-webhook-1`
The prototype is available through Docker by using the following command:
```bash
docker run -p 7700:7700 -v $(pwd)/meili_data:/meili_data getmeili/meilisearch:prototype-task-queue-webhook-1
```
# Pull Request
Implements the task queue webhook.
## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/4236
## What does this PR do?
- Provide a new cli and env var for the webhook, respectively called `--task-webhook-url` and `MEILI_TASK_WEBHOOK_URL`
- Also supports sending the requests with a custom `Authorization` header by specifying the optional `--task-webhook-authorization-header` CLI parameter or `MEILI_TASK_WEBHOOK_AUTHORIZATION_HEADER` env variable.
- Throw an error if the specified URL is invalid
- Every time a batch is processed, send all the finished tasks into the webhook with our public `TaskView` type as a JSON Line GZIPed body.
- Add one test.
## PR checklist
### Before becoming ready to review
- [x] Add a test
- [x] Compress the data we send
- [x] Chunk and stream the data we send
- [x] Remove the unwrap in the index-scheduler when sending the data fails
- [x] The analytics are missing
### Before merging
- [x] Release a prototype
Co-authored-by: Tamo <tamo@meilisearch.com >
Co-authored-by: Clément Renault <clement@meilisearch.com >
2023-12-21 14:43:46 +00:00
ee54d3171e
Check experimental feature at query time
2023-12-21 15:26:12 +01:00
2e4c9651df
Validate settings in route
2023-12-20 17:16:46 +01:00
fa2b96b9a5
Add an Authorization Header along with the webhook calls
2023-12-19 12:18:45 +01:00
19736cefe8
add the analytics
2023-12-19 10:36:04 +01:00
4fb25b8782
fix clippy
2023-12-19 10:35:51 +01:00
547379abb0
parse the url correctly
2023-12-19 10:35:51 +01:00
3adbc2b942
return a task view instead of a task
2023-12-19 10:35:51 +01:00
d78ad51082
Implement the webhook
2023-12-19 10:35:50 +01:00
1956045a06
add the option
2023-12-19 10:23:56 +01:00
9e1b458010
Merge branch 'main' into change-proximity-precision-settings
2023-12-18 09:08:47 +01:00
e741bc1c62
Add proximity_precision value into the analytics
2023-12-14 16:48:06 +01:00
87bba98bd8
Various changes
...
- fixed seed for arroy
- check vector dimensions as soon as it is provided to search
- don't embed whitespace
2023-12-14 16:08:42 +01:00
217105b7da
hybrid search uses semantic ratio, error handling
2023-12-14 16:08:42 +01:00
1b7c164a55
Pass the semantic ratio to milli
2023-12-14 16:08:42 +01:00
f3f3944469
Fix error checking
2023-12-14 16:08:42 +01:00
93dcbf598d
Deserialize semantic ratio
2023-12-14 16:08:42 +01:00
9991152bbe
Add TODOs
2023-12-14 16:08:42 +01:00
3c1a14f1cd
Add settings routes
2023-12-14 16:08:42 +01:00
e0cc775dc4
Various changes
...
- DistributionShift in Search object (to be set from model in embed?)
- Fix issue where embedder index wasn't computed at search time
- Accept as default embedder either the "default" one, or the only embedder when there is only one
2023-12-14 16:08:41 +01:00
12940d79a9
WIP
...
- manual embedder
- multi embedders OK
- clippy + tests OK
2023-12-14 16:08:41 +01:00
922a640188
WIP multi embedders
...
fixed template bugs
2023-12-14 16:08:41 +01:00
65e49b7092
Remove stuff, add distribution shift (WIP)
2023-12-14 16:08:38 +01:00
13c2c6c16b
Small commit to add hybrid search and autoembedding
2023-12-14 16:07:48 +01:00
