snowykami/meilisearch
1
0
Fork 0
mirror of https://github.com/meilisearch/meilisearch.git synced 2025-11-04 01:46:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
7,614 Commits 259 Branches 544 Tags
a86aeba41109cfa9aa42fc53258407db95855b4c
Commit Graph

660 Commits

Author SHA1 Message Date
Many
3b1358b62f Update milli/src/search/criteria/attribute.rs 
Co-authored-by: Clément Renault <clement@meilisearch.com>
 2021-04-27 17:32:19 +02:00
Many
c862b1bc6b Update milli/src/search/criteria/attribute.rs 
Co-authored-by: Clément Renault <clement@meilisearch.com>
 2021-04-27 17:32:10 +02:00
Many
e92d137676 Update milli/src/search/criteria/attribute.rs 
Co-authored-by: Clément Renault <clement@meilisearch.com>
 2021-04-27 17:31:42 +02:00
Many
b3d6c6a9a0 Update milli/src/search/criteria/attribute.rs 
Co-authored-by: Clément Renault <clement@meilisearch.com>
 2021-04-27 17:31:13 +02:00
Many
498c2b298c Update milli/src/search/criteria/attribute.rs 
Co-authored-by: Clément Renault <clement@meilisearch.com>
 2021-04-27 17:30:02 +02:00
Many
0e4e6dfada Update milli/src/search/criteria/proximity.rs 
Co-authored-by: Clément Renault <clement@meilisearch.com>
 2021-04-27 17:29:52 +02:00
Many
47d780b8ce Update milli/src/search/criteria/mod.rs 
Co-authored-by: Irevoire <tamo@meilisearch.com>
 2021-04-27 14:39:53 +02:00
Many
0daa0e170a Fix PR comments 
Co-authored-by: Clément Renault <clement@meilisearch.com>
 2021-04-27 14:39:53 +02:00
many
71740805a7 Fix forgotten typo tests 2021-04-27 14:39:53 +02:00
many
e77291a6f3 Optimize Atrribute criterion on big requests 2021-04-27 14:39:53 +02:00
many
716c8e22b0 Add style and comments 2021-04-27 14:39:52 +02:00
many
f853790016 Use the LCM of 10 first numbers to compute attribute rank 2021-04-27 14:39:52 +02:00
many
2b036449be Fix the return of equal candidates in different pages 2021-04-27 14:39:52 +02:00
many
0efa011e09 Make a small code clean-up 2021-04-27 14:39:52 +02:00
many
17c8c6f945 Make set algorithm return None when nothing can be returned 2021-04-27 14:39:52 +02:00
many
b3e2280bb9 Debug attribute criterion 
* debug folding when initializing iterators
 2021-04-27 14:39:52 +02:00
many
1eee0029a8 Make attribute criterion typo/prefix tolerant 2021-04-27 14:39:52 +02:00
many
59f58c15f7 Implement attribute criterion 
* Implement WordLevelIterator
* Implement QueryLevelIterator
* Implement set algorithm based on iterators

Not tested + Some TODO to fix
 2021-04-27 14:39:52 +02:00
Clément Renault
361193099f Reduce the amount of branches when query tree flattened 2021-04-27 14:39:52 +02:00
many
ab92c814c3 Fix attributes score 2021-04-27 14:35:43 +02:00
Clément Renault
658f316511 Introduce the Initial Criterion 2021-04-27 14:35:43 +02:00
many
75e7b1e3da Implement test Context methods 2021-04-27 14:25:34 +02:00
many
4ff67ec2ee Implement attribute criterion for small amounts of candidates 2021-04-27 14:25:34 +02:00
Kerollmops
0f4c0beffd Introduce the Attribute criterion 2021-04-27 14:25:34 +02:00
tamo
f8dee1b402 [makes clippy happy] search/criteria/proximity.rs 2021-04-21 12:36:45 +02:00
Alexey Shekhirin
6fa00c61d2 feat(search): support words_limit 2021-04-20 12:22:04 +03:00
Kerollmops
2aeef09316 Remove debug logs while iterating through the facet levels 2021-04-20 10:23:31 +02:00
Kerollmops
51767725b2 Simplify integer and float functions trait bounds 2021-04-20 10:23:31 +02:00
Alexey Shekhirin
33860bc3b7 test(update, settings): set & reset synonyms 
fixes after review

more fixes after review
 2021-04-18 11:24:17 +03:00
Alexey Shekhirin
e39aabbfe6 feat(search, update): synonyms 2021-04-18 11:24:17 +03:00
Marin Postma
9c4660d3d6 add tests 2021-04-15 16:25:56 +02:00
Marin Postma
75464a1baa review fixes 2021-04-15 16:25:56 +02:00
Marin Postma
2f73fa55ae add documentation 2021-04-15 16:25:55 +02:00
Marin Postma
45c45e11dd implement distinct attribute 
distinct can return error

facet distinct on numbers

return distinct error

review fixes

make get_facet_value more generic

fixes
 2021-04-15 16:25:55 +02:00
tamo
dcb00b2e54 test a new implementation of the stop_words 2021-04-12 18:35:33 +02:00
tamo
da036dcc3e Revert "Integrate the stop_words in the querytree" 
This reverts commit 12fb509d84.
We revert this commit because it's causing the bug #150.
The initial algorithm we implemented for the stop_words was:

1. remove the stop_words from the dataset
2. keep the stop_words in the query to see if we can generate new words by
   integrating typos or if the word was a prefix
=> This was causing the bug since, in the case of “The hobbit”, we were
   **always** looking for something starting with “t he” or “th e”
   instead of ignoring the word completely.

For now we are going to fix the bug by completely ignoring the
stop_words in the query.
This could cause another problem were someone mistyped a normal word and
ended up typing a stop_word.

For example imagine someone searching for the music “Won't he do it”.
If that person misplace one space and write “Won' the do it” then we
will loose a part of the request.

One fix would be to update our query tree to something like that:

---------------------
OR
  OR
    TOLERANT hobbit # the first option is to ignore the stop_word
    AND
      CONSECUTIVE   # the second option is to do as we are doing
        EXACT t	    # currently
        EXACT he
      TOLERANT hobbit
---------------------

This would increase drastically the size of our query tree on request
with a lot of stop_words. For example think of “The Lord Of The Rings”.

For now whatsoever we decided we were going to ignore this problem and consider
that it doesn't reduce too much the relevancy of the search to do that
while it improves the performances.
 2021-04-12 18:35:33 +02:00
tamo
12fb509d84 Integrate the stop_words in the querytree 
remove the stop_words from the querytree except if it was a prefix or a typo
 2021-04-01 13:57:55 +02:00
tamo
a2f46029c7 implement a first version of the stop_words 
The front must provide a BTreeSet containing the stop words
The stop_words are set at None if an empty Set is provided
add the stop-words in the http-ui interface

Use maplit in the test
and remove all the useless drop(rtxn) at the end of all tests
 2021-04-01 13:57:55 +02:00
Alexey Shekhirin
1e3f05db8f use fixed number of candidates as a threshold 2021-03-30 11:57:10 +03:00
Alexey Shekhirin
a776ec9718 fix division 2021-03-29 19:16:58 +03:00
Alexey Shekhirin
522e79f2e0 feat(search, criteria): introduce a percentage threshold to the asc/desc 2021-03-29 19:08:31 +03:00
mpostma
9c27183876 fix broken offset 2021-03-15 20:23:50 +01:00
Kerollmops
d48008339e Introduce two new optional_words and authorize_typos Search options 2021-03-10 11:16:30 +01:00
Kerollmops
54b97ed8e1 Update the fetcher comments 2021-03-10 10:56:26 +01:00
Kerollmops
d301859bbd Introduce a special word_derivations function for Proximity 2021-03-10 10:42:53 +01:00
Kerollmops
facfb4b615 Fix the bucket candidates 2021-03-10 10:42:53 +01:00
Kerollmops
42fd7dea78 Remove the useless typo cache 2021-03-10 10:42:53 +01:00
many
62a70c300d Optimize words criterion 2021-03-10 10:42:53 +01:00
Kerollmops
d781a6164a Rewrite some code with idiomatic Rust 2021-03-08 16:27:52 +01:00
Clément Renault
b18ec00a7a Add a logging_timer macro to te criterion next methods 2021-03-08 16:12:06 +01:00