Commit Graph

98 Commits

Author SHA1 Message Date
aa6c5df0bc Implement documents format
document reader transform

remove update format

support document sequences

fix document transform

clean transform

improve error handling

add documents! macro

fix transform bug

fix tests

remove csv dependency

Add comments on the transform process

replace search cli

fmt

review edits

fix http ui

fix clippy warnings

Revert "fix clippy warnings"

This reverts commit a1ce3cd96e603633dbf43e9e0b12b2453c9c5620.

fix review comments

remove smallvec in transform loop

review edits
2021-09-21 16:58:33 +02:00
41bdc90f46 Revert "Enable optimization in every profile" 2021-06-16 14:17:02 +02:00
86b916b008 enable optimization in every profile 2021-06-09 10:26:57 +02:00
e0c327bae2 Update Cargo.toml
Co-authored-by: Clément Renault <clement@meilisearch.com>
2021-06-08 11:39:10 +02:00
c82a382b0b compile every build.rs with optimization 2021-06-08 11:19:22 +02:00
06c414a753 move the benchmarks to another crate so we can download the datasets automatically without adding overhead to the build of milli 2021-06-02 11:11:50 +02:00
9423310816 Introduce an helpers crate that export the database to stdout 2021-03-01 19:55:04 +01:00
fecf3d6fc1 Move the command lines helpers into different crates 2021-02-14 18:55:15 +01:00
e8639517da Change the project to become a workspace with milli as a default-member 2021-02-12 16:15:09 +01:00
433ac8c38a Remove the ordered-float serde feature 2021-01-27 14:11:10 +01:00
61dbcfa44a Bump the roaring to 0.6.4 2021-01-26 14:38:43 +01:00
51a37de885 Introduce the FacetValue enum type 2021-01-26 14:09:09 +01:00
1ae761311e integrate with meilisearch tokenizer 2021-01-07 16:14:27 +01:00
77e951e933 Use the byte-unit crate to ease library usage 2020-12-20 12:00:37 +01:00
e7f2ab9138 Bump grenad to fix an indexing bug 2020-12-05 16:39:15 +01:00
0959e1501f Introduce the FacetRevRange Iterator struct 2020-12-04 12:02:23 +01:00
61b383f422 Introduce the criteria update setting 2020-12-04 12:02:22 +01:00
a0adfb5e8e Introduce a real pest parser and support every facet filter conditions 2020-11-23 16:43:55 +01:00
07a0c82790 Bump heed to 0.10.4 to use be able to lazily decode roaring bitmaps 2020-11-23 16:43:53 +01:00
38c76754ef Make the facet level search system generic on f64 and i64 2020-11-23 16:43:52 +01:00
b255be93fa Bump heed to 0.10.3 2020-11-23 16:43:49 +01:00
a18d9a1f87 Parse and store the faceted fields 2020-11-13 16:13:51 +01:00
640c7d748a Modify the highlight function to support any JSON type 2020-11-05 13:59:32 +01:00
0408c9d66a Move the http server into its own sub-module 2020-11-05 11:16:39 +01:00
4fded5bd0e Bump heed to be able to reference a RoTxn from multiple threads 2020-11-02 12:49:23 +01:00
f0d028d3a4 Update the Transform struct to support JSON updates 2020-10-31 20:52:49 +01:00
9d47ee52b4 Generate a uuid v4 based document id when missing 2020-10-31 15:11:06 +01:00
085d3b9d94 Update heed to 0.10.0 2020-10-30 11:42:00 +01:00
b5d52b6b45 Prefer using a smallstr instead of a real String to reduce allocations 2020-10-29 14:32:32 +01:00
98fc24cbdf Bump heed to fix a prefix iter bug 2020-10-28 10:55:21 +01:00
b44b04d25b Serialize the CSV record values as JSON strings 2020-10-24 14:43:46 +02:00
802e925fd7 Switch to a JSON protocol for the front page 2020-10-21 18:26:29 +02:00
2210818114 Introduce the obkv heed codec 2020-10-21 15:51:48 +02:00
f948a03be2 Optimise the merge functions to avoid allocations 2020-10-20 16:40:50 +02:00
cde8478388 Replace the panic in the merge function by actual errors 2020-10-20 16:19:07 +02:00
35c9a3c558 Brodacast the updates infos to every ws clients 2020-10-20 11:19:34 +02:00
871222aebd Introduce some new routes to handle live indexing 2020-10-19 16:06:43 +02:00
65e32fecb1 Move the binaries into one with subcommands 2020-10-19 13:44:17 +02:00
eca49e3a03 Introduce a notification channel for the UpdateStore 2020-10-18 16:37:37 +02:00
83c1db8763 Introduce the UpdateStore 2020-10-18 15:26:57 +02:00
9021b2dba6 Introduce the enable-chunk-fusing flag 2020-10-14 18:44:59 +02:00
f980422c57 Move from oxidized-mtbl to grenad 2020-10-14 12:47:32 +02:00
4e9bd1fef5 Bump oxidized-mtbl 2020-10-07 14:23:22 +02:00
433d9bbc6e Use CompressionType::from_str rather than a custom function 2020-10-06 13:50:34 +02:00
4b819457c9 Enable the strucopt/clap warp help feature 2020-10-06 13:06:22 +02:00
770f29fd05 Bump the oxidized-mtbl dependency 2020-10-04 17:04:33 +02:00
acd2a63879 Introduce a simple FST based chinese word segmenter 2020-10-04 17:04:33 +02:00
68f4af7d2e Improve the display of the number of processed documents 2020-09-29 16:08:58 +02:00
ed05999f63 Replace the arc cache by a simple linked hash map 2020-09-23 14:50:52 +02:00
d6fa9c0414 Index the intra documents word pair proximities 2020-09-22 14:04:33 +02:00