Commit Graph

182 Commits

Author SHA1 Message Date
1ef87cc6d0 chore: move permissive-json-pointer in the meilisearch repository
Update permissive-json-pointer/src/lib.rs

Co-authored-by: Clément Renault <clement@meilisearch.com>
2022-04-20 19:24:41 +02:00
c2469b6765 create the json-depth-checker crate 2022-04-14 11:14:08 +02:00
bab898ce86 move the flatten-serde-json crate inside of milli 2022-04-07 18:20:44 +02:00
2a31cd13c9 set resolver to v2 2022-03-16 11:47:27 +01:00
748d5b69a5 cargo: use resolver 2 2022-03-14 23:18:59 -04:00
3ecebd15ee chore(all): fix rust edition 2022-01-12 11:14:50 +01:00
5fb4ed60e7 chore(all) set rust edition to 2021 2022-01-06 13:30:45 +01:00
ffefd0caf2 feat(auth): API keys
implements:
https://github.com/meilisearch/specifications/blob/develop/text/0085-api-keys.md

- Add tests on API keys management route (meilisearch-http/tests/auth/api_keys.rs)
- Add tests checking authorizations on each meilisearch routes (meilisearch-http/tests/auth/authorization.rs)
- Implement API keys management routes (meilisearch-http/src/routes/api_key.rs)
- Create module to manage API keys and authorizations (meilisearch-auth)
- Reimplement GuardedData to extend authorizations (meilisearch-http/src/extractors/authentication/mod.rs)
- Change X-MEILI-API-KEY by Authorization Bearer (meilisearch-http/src/extractors/authentication/mod.rs)
- Change meilisearch routes to fit to the new authorization feature (meilisearch-http/src/routes/)

- close #1867
2021-12-06 09:52:41 +01:00
a30e02c18c feat(all): Task store
implements:
https://github.com/meilisearch/specifications/blob/develop/text/0060-refashion-updates-apis.md

linked PR:

- #1889
- #1891
- #1892
- #1902
- #1906
- #1911
- #1914
- #1915
- #1916
- #1918
- #1924
- #1925
- #1926
- #1930
- #1936
- #1937
- #1942
- #1944
- #1945
- #1946
- #1947
- #1950
- #1951
- #1957
- #1959
- #1960
- #1961
- #1962
- #1964

- https://github.com/meilisearch/milli/pull/414
- https://github.com/meilisearch/milli/pull/409
- https://github.com/meilisearch/milli/pull/406
- https://github.com/meilisearch/milli/pull/418

- close #1687
- close #1786
- close #1940
- close #1948
- close #1949
- close #1932
- close #1956
2021-12-02 20:14:42 +01:00
f28600031d Rename the filter_parser crate into filter-parser
Co-authored-by: Clément Renault <clement@meilisearch.com>
2021-11-09 16:41:10 +01:00
7e5c5c4d27 start a new rewrite of the filter parser 2021-10-22 01:15:42 +02:00
14c6ae4735 disable stripping 2021-10-07 12:10:36 +02:00
493a0e377d optimize build size 2021-10-07 11:49:52 +02:00
5fad37aebd Merge #1711
1711: MeiliSearch refactor introducing OBKV format r=MarinPostma a=MarinPostma

This PR refactor some multiple components of meilisearch, and introduce the obkv document format to meilisearch

- [x] Split meilisearch-http and meilisearch-lib
- [x] Replace `IndexActor` and `UuidResolver` with `IndexResolver`
- [x] Remove mentions to Actor
- [x] Remove Actor traits to simplify code
- [x] Integrate obkv document format
- [x] Remove `Data`
- [x] Restore all route
- [x] Replace `Box<dyn error>` with `anyhow::Error`
- [x] Introduce update file store
- [x] Update file store error handling
- [x] Fix dumps
- [x] Fix snapshots
- [x] Fix tests
- [x] Update module documentation
- [x] add csv suppport (feat `@ManyTheFish` #1729 )
- [x] add jsonl support
- [x] integrate geosearch (feat `@irevoire` #1725) 

partially implements #1691 and #1690. The error handling is very basic now, I will finish it in the next pr.

Some unit tests have been disabled, I will re-enable them ASAP, but they need a bit more work.

close #1531 


P.S: sorry for this monstrous PR :'(

Co-authored-by: mpostma <postma.marin@protonmail.com>
Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: many <maxime@meilisearch.com>
2021-09-29 14:38:55 +00:00
aa6c5df0bc Implement documents format
document reader transform

remove update format

support document sequences

fix document transform

clean transform

improve error handling

add documents! macro

fix transform bug

fix tests

remove csv dependency

Add comments on the transform process

replace search cli

fmt

review edits

fix http ui

fix clippy warnings

Revert "fix clippy warnings"

This reverts commit a1ce3cd96e603633dbf43e9e0b12b2453c9c5620.

fix review comments

remove smallvec in transform loop

review edits
2021-09-21 16:58:33 +02:00
60518449fc split meilisearch-http and meilisearch-lib 2021-09-21 13:23:22 +02:00
770b6d25ae deps: unify pest dependency 2021-09-15 12:15:44 +09:00
41bdc90f46 Revert "Enable optimization in every profile" 2021-06-16 14:17:02 +02:00
86b916b008 enable optimization in every profile 2021-06-09 10:26:57 +02:00
e0c327bae2 Update Cargo.toml
Co-authored-by: Clément Renault <clement@meilisearch.com>
2021-06-08 11:39:10 +02:00
c82a382b0b compile every build.rs with optimization 2021-06-08 11:19:22 +02:00
06c414a753 move the benchmarks to another crate so we can download the datasets automatically without adding overhead to the build of milli 2021-06-02 11:11:50 +02:00
9423310816 Introduce an helpers crate that export the database to stdout 2021-03-01 19:55:04 +01:00
a9a9ed6318 create workspace with meilisearch-error 2021-03-01 14:41:55 +01:00
79708aeb67 add milli as git dep 2021-03-01 14:41:20 +01:00
5ba58c1e9c add Marin to authors 2021-02-28 10:09:56 +01:00
91d6e90d5d enable faceted searches 2021-02-16 19:20:39 +01:00
fecf3d6fc1 Move the command lines helpers into different crates 2021-02-14 18:55:15 +01:00
e8639517da Change the project to become a workspace with milli as a default-member 2021-02-12 16:15:09 +01:00
f8f02af23e incorporate review changes 2021-02-04 13:21:15 +01:00
9af0a08122 post review fixes 2021-02-02 17:34:06 +01:00
17c463ca61 remove unused deps 2021-02-01 13:32:21 +01:00
6c63ee6798 implement list all indexes 2021-01-28 18:32:24 +01:00
74410d8c6b architecture rework 2021-01-28 14:12:34 +01:00
433ac8c38a Remove the ordered-float serde feature 2021-01-27 14:11:10 +01:00
61dbcfa44a Bump the roaring to 0.6.4 2021-01-26 14:38:43 +01:00
51a37de885 Introduce the FacetValue enum type 2021-01-26 14:09:09 +01:00
6a3f625e11 WIP: refactor IndexController
change the architecture of the index controller to allow it to own an
index store.
2021-01-16 15:09:48 +01:00
686f987180 fix compile errors 2021-01-14 11:27:07 +01:00
ddd7789713 WIP: IndexController 2021-01-13 17:50:36 +01:00
1ae761311e integrate with meilisearch tokenizer 2021-01-07 16:14:27 +01:00
0cd9e62fc6 search first iteration 2020-12-24 12:58:34 +01:00
02ef1d41d7 route document add json 2020-12-23 16:12:37 +01:00
1a38bfd31f data add documents 2020-12-23 13:52:28 +01:00
55e1552957 update queue refactor, first iteration 2020-12-22 17:13:50 +01:00
7c9eaaeadb clean code, and fix errors 2020-12-22 14:02:41 +01:00
77e951e933 Use the byte-unit crate to ease library usage 2020-12-20 12:00:37 +01:00
8c0ab106c7 initial commit 2020-12-12 13:32:06 +01:00
e7f2ab9138 Bump grenad to fix an indexing bug 2020-12-05 16:39:15 +01:00
0959e1501f Introduce the FacetRevRange Iterator struct 2020-12-04 12:02:23 +01:00