16eab7b337
I can index documents without meilisearch
2022-10-20 15:30:20 +02:00
7bbd75e1fb
wip
2022-10-20 15:29:48 +02:00
a4bf859779
create the end Batch type for all Index* operations
2022-10-20 15:29:48 +02:00
72496122c3
create the end Batch type for all Document* operation
2022-10-20 15:29:48 +02:00
d7146d7b21
write most of the run loop
2022-10-20 15:29:48 +02:00
e9d2689499
use faux in the file-store
2022-10-20 15:29:36 +02:00
0acc40b222
split the run function in two
2022-10-20 15:28:51 +02:00
9069439a14
fix the register test
2022-10-20 15:28:51 +02:00
e7c552a0d0
reduce the size of the snapshots
2022-10-20 15:28:50 +02:00
cfc01e4372
test the register tasks
2022-10-20 15:28:50 +02:00
f84ced7e38
start integrating the index-scheduler in the meilisearch codebase
2022-10-20 15:28:50 +02:00
9882b7fa57
greatly reduce the number of warnings
2022-10-20 15:26:57 +02:00
1a4461cd3a
fix smol typo
2022-10-20 15:26:57 +02:00
ce0ebf9381
get rids of the horrendous spinlock in favor of synchronoise
2022-10-20 15:26:57 +02:00
3001ed3a5f
implement the index swap in the index mapper
2022-10-20 15:26:46 +02:00
c326613e06
move the index mapping logic in another structure
2022-10-20 15:26:45 +02:00
48e10176b2
migrate the index handling code in a different file + implements the create index
2022-10-20 15:26:45 +02:00
f7357fc504
reintroduce the uuid mapping for the indexes
2022-10-20 15:26:45 +02:00
5b485e309c
add a bunch of tests
2022-10-20 15:26:45 +02:00
3120057039
split the DocumentAdditionOrUpdate in two tasks; DocumentAddition and DocumentUpdate
2022-10-20 15:26:33 +02:00
00f13f45b6
starts importing the real tasks
2022-10-20 15:26:32 +02:00
bbb50d1b96
get rids of the auto-generated mains
2022-10-20 15:26:32 +02:00
cf8c4310ab
extract the index abstraction out of the index-scheduler in its own module
2022-10-20 15:26:32 +02:00
5abb79f149
rename the update-file-store to file-store since it can store any kind of file
2022-10-20 15:26:22 +02:00
5dcd67c597
import the update_file_store in the index-scheduler
2022-10-20 15:26:22 +02:00
215d318b53
get rids of nelson
2022-10-20 15:26:22 +02:00
68e74e133f
move the update file store to another crate with as little dependencies as possible
2022-10-20 15:26:06 +02:00
98bb742d77
finishes the global skelton of the auto-batcher
2022-10-20 15:26:06 +02:00
1efccb1bc4
polish the global structure of the batch creation
2022-10-20 15:26:06 +02:00
78ca4bf608
move the autobatcher logic to another file
2022-10-20 15:26:06 +02:00
66397bd0de
add the document format file
2022-10-20 15:26:06 +02:00
0790a3cbbf
fix the create_new_batch method
2022-10-20 15:26:06 +02:00
074dee59ec
fix the whole batchKind thingy
2022-10-20 15:26:05 +02:00
ef4594c078
implements most operations
2022-10-20 15:26:05 +02:00
9aa31cd391
fix a few typos
2022-10-20 15:26:05 +02:00
b1f0431ab4
implements the index deletion, creation and swap
2022-10-20 15:26:05 +02:00
fa27485070
makes the updates getters smoother to uses
2022-10-20 15:26:05 +02:00
7c56fcfef3
make the project compile again
2022-10-20 15:26:05 +02:00
d87b769469
fix the file store
2022-10-20 15:26:04 +02:00
faac665d58
make the file store entirely synchronous, including the file deletion
2022-10-20 15:26:04 +02:00
fda5ca60bd
fix most of the index module
2022-10-20 15:26:04 +02:00
e7b2b9306a
wip porting the index back in the scheduler
2022-10-20 15:25:55 +02:00
a2587149f4
add a little bit of documentation
2022-10-20 15:25:42 +02:00
f359fcc220
implements the filter query
2022-10-20 15:25:41 +02:00
c1eda13e64
add the task to the index db in the register task
2022-10-20 15:25:41 +02:00
2b77d54412
split the scheduler into multiples files
2022-10-20 15:25:41 +02:00
ff5d6d1703
implement the get_batch method
2022-10-20 15:25:41 +02:00
5a9ac4ceb3
START THE REWRITE OF THE INDEX SCHEDULER: index & register has been implemented
2022-10-20 15:25:41 +02:00
f2279f4615
Merge #2928
...
2928: Improve default config file r=curquiza a=curquiza
Following https://github.com/meilisearch/meilisearch/pull/2745#pullrequestreview-1115361274
`@gmourier` `@maryamsulemani97,` here are the changes I applied
- [After discussing with the cloud team](https://meilisearch.slack.com/archives/C03T1T47TUG/p1666014688582379 ) (internal link only), I let commented and uncommented the variables depending on their role.
- The only boolean variable I let be commented is the `no_analytics` one, and I wrote the non-default value (i.e. `true`)-> it will be easier for the users to disable analytics by only uncommenting the line. Plus, `no_analytics = false` is a double negative and not really easy to understand.
- I removed the `INDEX` section that was not really related to indexes
- I keep only 4 sections: SSL, Dumps, Snapshots, and an untitled section with all the uncategorized variables. I gathered all the uncategorized variable at the top of the file, so in the "untitled" section.
- I copied/pasted the really basic [documentation description](https://docs.meilisearch.com/learn/configuration/instance_options.html ) of the variables
- I added every doc linked to each variable.
Let me know if you agree or not with my choices!
Thanks for your review 🙏
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com >
2022-10-19 11:49:33 +00:00
48058b5e56
Improve default config file
2022-10-18 15:28:32 +02:00