snowykami/meilisearch
1
0
Fork 0
mirror of https://github.com/meilisearch/meilisearch.git synced 2025-07-27 00:31:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,093 Commits 240 Branches 478 Tags
7bbd75e1fbf555b894881377477054c357d5262c
Commit Graph

4093 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tamo
7bbd75e1fb wip 2022-10-20 15:29:48 +02:00
Tamo
a4bf859779 create the end Batch type for all Index* operations 2022-10-20 15:29:48 +02:00
Tamo
72496122c3 create the end Batch type for all Document* operation 2022-10-20 15:29:48 +02:00
Tamo
d7146d7b21 write most of the run loop 2022-10-20 15:29:48 +02:00
Tamo
e9d2689499 use faux in the file-store 2022-10-20 15:29:36 +02:00
Tamo
0acc40b222 split the run function in two 2022-10-20 15:28:51 +02:00
Tamo
9069439a14 fix the register test 2022-10-20 15:28:51 +02:00
Tamo
e7c552a0d0 reduce the size of the snapshots 2022-10-20 15:28:50 +02:00
Tamo
cfc01e4372 test the register tasks 2022-10-20 15:28:50 +02:00
Tamo
f84ced7e38 start integrating the index-scheduler in the meilisearch codebase 2022-10-20 15:28:50 +02:00
Tamo
9882b7fa57 greatly reduce the number of warnings 2022-10-20 15:26:57 +02:00
Tamo
1a4461cd3a fix smol typo 2022-10-20 15:26:57 +02:00
Tamo
ce0ebf9381 get rids of the horrendous spinlock in favor of synchronoise 2022-10-20 15:26:57 +02:00
Tamo
3001ed3a5f implement the index swap in the index mapper 2022-10-20 15:26:46 +02:00
Tamo
c326613e06 move the index mapping logic in another structure 2022-10-20 15:26:45 +02:00
Tamo
48e10176b2 migrate the index handling code in a different file + implements the create index 2022-10-20 15:26:45 +02:00
Tamo
f7357fc504 reintroduce the uuid mapping for the indexes 2022-10-20 15:26:45 +02:00
Tamo
5b485e309c add a bunch of tests 2022-10-20 15:26:45 +02:00
Tamo
3120057039 split the DocumentAdditionOrUpdate in two tasks; DocumentAddition and DocumentUpdate 2022-10-20 15:26:33 +02:00
Tamo
00f13f45b6 starts importing the real tasks 2022-10-20 15:26:32 +02:00
Tamo
bbb50d1b96 get rids of the auto-generated mains 2022-10-20 15:26:32 +02:00
Tamo
cf8c4310ab extract the index abstraction out of the index-scheduler in its own module 2022-10-20 15:26:32 +02:00
Tamo
5abb79f149 rename the update-file-store to file-store since it can store any kind of file 2022-10-20 15:26:22 +02:00
Tamo
5dcd67c597 import the update_file_store in the index-scheduler 2022-10-20 15:26:22 +02:00
Tamo
215d318b53 get rids of nelson 2022-10-20 15:26:22 +02:00
Tamo
68e74e133f move the update file store to another crate with as little dependencies as possible 2022-10-20 15:26:06 +02:00
Tamo
98bb742d77 finishes the global skelton of the auto-batcher 2022-10-20 15:26:06 +02:00
Tamo
1efccb1bc4 polish the global structure of the batch creation 2022-10-20 15:26:06 +02:00
Irevoire
78ca4bf608 move the autobatcher logic to another file 2022-10-20 15:26:06 +02:00
Tamo
66397bd0de add the document format file 2022-10-20 15:26:06 +02:00
Tamo
0790a3cbbf fix the create_new_batch method 2022-10-20 15:26:06 +02:00
Tamo
074dee59ec fix the whole batchKind thingy 2022-10-20 15:26:05 +02:00
Tamo
ef4594c078 implements most operations 2022-10-20 15:26:05 +02:00
Tamo
9aa31cd391 fix a few typos 2022-10-20 15:26:05 +02:00
Tamo
b1f0431ab4 implements the index deletion, creation and swap 2022-10-20 15:26:05 +02:00
Tamo
fa27485070 makes the updates getters smoother to uses 2022-10-20 15:26:05 +02:00
Tamo
7c56fcfef3 make the project compile again 2022-10-20 15:26:05 +02:00
Tamo
d87b769469 fix the file store 2022-10-20 15:26:04 +02:00
Tamo
faac665d58 make the file store entirely synchronous, including the file deletion 2022-10-20 15:26:04 +02:00
Tamo
fda5ca60bd fix most of the index module 2022-10-20 15:26:04 +02:00
Irevoire
e7b2b9306a wip porting the index back in the scheduler 2022-10-20 15:25:55 +02:00
Irevoire
a2587149f4 add a little bit of documentation 2022-10-20 15:25:42 +02:00
Tamo
f359fcc220 implements the filter query 2022-10-20 15:25:41 +02:00
Tamo
c1eda13e64 add the task to the index db in the register task 2022-10-20 15:25:41 +02:00
Tamo
2b77d54412 split the scheduler into multiples files 2022-10-20 15:25:41 +02:00
Tamo
ff5d6d1703 implement the get_batch method 2022-10-20 15:25:41 +02:00
Tamo
5a9ac4ceb3 START THE REWRITE OF THE INDEX SCHEDULER: index & register has been implemented 2022-10-20 15:25:41 +02:00
bors[bot]
f2279f4615 Merge #2928 
2928: Improve default config file r=curquiza a=curquiza

Following https://github.com/meilisearch/meilisearch/pull/2745#pullrequestreview-1115361274

`@gmourier` `@maryamsulemani97,` here are the changes I applied
- [After discussing with the cloud team](https://meilisearch.slack.com/archives/C03T1T47TUG/p1666014688582379) (internal link only), I let commented and uncommented the variables depending on their role.
- The only boolean variable I let be commented is the `no_analytics` one, and I wrote the non-default value (i.e. `true`)-> it will be easier for the users to disable analytics by only uncommenting the line. Plus, `no_analytics = false` is a double negative and not really easy to understand.
- I removed the `INDEX` section that was not really related to indexes
- I keep only 4 sections: SSL, Dumps, Snapshots, and an untitled section with all the uncategorized variables. I gathered all the uncategorized variable at the top of the file, so in the "untitled" section.
- I copied/pasted the really basic [documentation description](https://docs.meilisearch.com/learn/configuration/instance_options.html) of the variables
- I added every doc linked to each variable. 

Let me know if you agree or not with my choices!
Thanks for your review 🙏 

Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
 2022-10-19 11:49:33 +00:00
Clémentine Urquizar
48058b5e56 Improve default config file 2022-10-18 15:28:32 +02:00
bors[bot]
96acbf815d Merge #2913 
2913: download-latest: some refactoring r=curquiza a=nfsec

# Pull Request

## What does this PR do?
- Usually the elevation of variables.

## PR checklist
Please check if your PR fulfills the following requirements:
- [X] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)?
- [X] Have you read the contributing guidelines?
- [X] Have you made sure that the title is accurate and descriptive of the changes?

Thank you so much for contributing to Meilisearch!


Co-authored-by: Patryk Krawaczyński <nfsec@users.noreply.github.com>
Co-authored-by: Clémentine Urquizar - curqui <clementine@meilisearch.com>
 2022-10-17 13:21:36 +00:00