snowykami/meilisearch
1
0
Fork 0
mirror of https://github.com/meilisearch/meilisearch.git synced 2025-10-26 21:46:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
12,672 Commits 252 Branches 544 Tags
cf43ec4affc00b9f2f81596d315e08be34371567
Commit Graph

12672 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Clément Renault
3abfe8aa22 Validate documents ids before accepting them 2020-11-01 20:55:21 +01:00
Clément Renault
0ccf4cf785 Simplify the IndexDocuments builder creation from the UpdateBuilder 2020-11-01 17:31:20 +01:00
Clément Renault
d8ff939409 Introduce bors to the project 2020-11-01 14:49:07 +01:00
Clément Renault
9047dc8163 Add a Github actions workflows 2020-11-01 14:47:44 +01:00
Clément Renault
600aa223c2 Fix a bug where generated docids were not saved when indexing JSON docs 2020-11-01 12:19:07 +01:00
Clément Renault
f0e63025b0 Update the Transform struct to support JSON stream updates 2020-11-01 12:19:06 +01:00
dependabot[bot]
93953103ad Bump serde from 1.0.116 to 1.0.117 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.116 to 1.0.117.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.116...v1.0.117)

Signed-off-by: dependabot[bot] <support@github.com>
 2020-11-01 05:40:44 +00:00
Kerollmops
082ad84914 Fix the benchmarks 2020-10-31 22:18:29 +01:00
Kerollmops
6d52c5b2f0 Introduce a parameter to disable the engine to autogenerate docids 2020-10-31 21:46:55 +01:00
Clément Renault
21b4d60101 Add replace/update csv/json from the HTTP server 2020-10-31 20:52:49 +01:00
Clément Renault
a4f8be7811 Support numbers and boolean when indexing JSON 2020-10-31 20:52:49 +01:00
Clément Renault
f0d028d3a4 Update the Transform struct to support JSON updates 2020-10-31 20:52:49 +01:00
Clément Renault
9d47ee52b4 Generate a uuid v4 based document id when missing 2020-10-31 15:11:06 +01:00
Clément Renault
ddbd336387 Introduce primary key methods on the index 2020-10-31 11:50:59 +01:00
Juan Eugenio Abadie
f25890c140 Make small improvements 2020-10-30 23:48:23 -03:00
Clément Renault
0d01e4854b Add a test to check that merging works correctly with CSVs 2020-10-30 13:46:56 +01:00
Clément Renault
955302fd95 Introduce an HTTP route to clear the documents 2020-10-30 13:12:55 +01:00
Clément Renault
7cc1a358f5 Fix a documents indexing bug and add a test 2020-10-30 12:14:25 +01:00
Clément Renault
99da69c85f Introduce the prepare_for_closing Index method 2020-10-30 11:46:14 +01:00
Clément Renault
222063b19d Introduce the Index path method 2020-10-30 11:46:00 +01:00
Clément Renault
085d3b9d94 Update heed to 0.10.0 2020-10-30 11:42:00 +01:00
Clément Renault
a30206a665 Prefer using iterator put_current instead of a get put method 2020-10-30 11:13:45 +01:00
Clément Renault
e63fdf2b22 Move the heed env into the index itself to ease the usage of the library 2020-10-30 10:56:35 +01:00
Clément Renault
b5d52b6b45 Prefer using a smallstr instead of a real String to reduce allocations 2020-10-29 14:32:32 +01:00
Clément Renault
40993a0d25 Fix an indexing process bug, where documents were not written in order 2020-10-29 14:20:03 +01:00
Clément Renault
855a251489 Enable the clear documents optimization that wasn't working due to a bug 2020-10-29 13:52:48 +01:00
bors[bot]
39cf1931ae Merge #1047 
1047: bump meilisearch r=Kerollmops a=MarinPostma



Co-authored-by: mpostma <postma.marin@protonmail.com>
v0.16.0rc0 		2020-10-28 11:42:24 +00:00
mpostma
bbb6771625 bump meilisearch 2020-10-28 12:36:52 +01:00
Clément Renault
1228c2948d Add a comment about the ClearDocuments operation in the DeleteDocuments 2020-10-28 11:17:36 +01:00
Clément Renault
98fc24cbdf Bump heed to fix a prefix iter bug 2020-10-28 10:55:21 +01:00
Kerollmops
d6338af766 Improve documents deletion by iterating over all the word pair positions 2020-10-27 18:50:09 +01:00
Clément Renault
3889d956d9 Introduce the UpdateBuilder and use it in the HTTP routes 2020-10-27 18:47:58 +01:00
bors[bot]
e9f9f270e1 Merge #1045 
1045: Revert "Merge #1037" r=MarinPostma a=MarinPostma

This reverts commit 257f9fb2b2, reversing
changes made to 9bae7a35bf.

The reason fo this is that de-unicoding is not always desirable (for example is the case of CJK documents). This cannot be handled correctly for now, and will necessitate work on the tokenizer.

Co-authored-by: mpostma <postma.marin@protonmail.com>
 2020-10-27 17:16:27 +00:00
mpostma
190b78b7be Revert "Merge #1037" 
This reverts commit 257f9fb2b2, reversing
changes made to 9bae7a35bf.
 2020-10-27 17:27:47 +01:00
bors[bot]
257f9fb2b2 Merge #1037 
1037: Synonym unidecode r=Kerollmops a=MarinPostma

fix #964 

- unidecodes all synonyms before adding them to the synonyms fst
- stores a copy of the original synonyms (unicoded) for later retrieve

Co-authored-by: mpostma <postma.marin@protonmail.com>
 2020-10-27 10:57:40 +00:00
mpostma
d35a104ad3 requested changes 2020-10-27 11:53:24 +01:00
bors[bot]
9bae7a35bf Merge #1032 
1032: Remove not maintained csv movies dataset r=MarinPostma a=bidoubiwa

Remove `movies.csv` from the dataset folder as it is not updated and not usable with MeiliSearch without converting it to json.

Co-authored-by: Charlotte Vermandel <charlottevermandel@gmail.com>
 2020-10-27 08:18:20 +00:00
mpostma
33c7c5a7e3 remove del_synonyms function 2020-10-26 21:33:39 +01:00
mpostma
91363daeaa add tests 2020-10-26 17:48:13 +01:00
mpostma
f9ab85adbe deunicase synonyms 2020-10-26 17:47:55 +01:00
Clément Renault
5c62fbb6a8 Move the IndexDocuments update into its own module 2020-10-26 12:21:13 +01:00
Clément Renault
8f76ec97c0 Move the DeleteDocuments update into its own module 2020-10-26 11:01:00 +01:00
Clément Renault
92ef1faa97 Move the ClearDocuments update into its own module 2020-10-26 10:58:17 +01:00
Clément Renault
1e1821f002 Introduce the merge_two_obkv function to merge documents on update 2020-10-26 10:55:07 +01:00
Clément Renault
60347a5483 Move the AvailableDocumentsIds iterator into the update module 2020-10-26 10:53:23 +01:00
Clément Renault
b14cca2ad9 Introduce the UpdateBuilder type along with some update operations 2020-10-25 18:32:01 +01:00
Clément Renault
adacc7977d Make the Index return default values when value don't exist 2020-10-25 18:30:24 +01:00
Clément Renault
a7a4984175 Introduce the Transform type into the indexing system 2020-10-24 17:06:09 +02:00
Clément Renault
b44b04d25b Serialize the CSV record values as JSON strings 2020-10-24 14:43:46 +02:00
Clément Renault
656a851830 Introduce the Transform struct transforming CSVs 
This allows us to:
  - transform a CSV, a JSON or a JSON lines data type into the same
    Grenad x Obkv streamable data type and creates the new FieldsIdsMap.
  - Extract all the documents user ids in advance to be able to delete
    the existing documents before re-indexing them.
  - Keep the last documents with the same user id avoiding duplicates
    in the same request.
 2020-10-24 13:37:38 +02:00