Commit Graph

8431 Commits

Author SHA1 Message Date
03b510945b ICE: use a git version of my crate so rust team can pull the repo 2023-10-31 17:59:59 +01:00
c3a8d4b7fb ICE 2023-10-31 17:39:10 +01:00
c573261ac4 WIP: start updating the zookeeper client => leader election is missing 2023-10-31 13:04:32 +01:00
8f04353b7d bump strois to a temporary version while we wait for rusty_s3 to do a new release again prototype-zookeeper-ha-7 2023-10-17 11:49:18 +02:00
b9983a48c7 No more create the S3 Bucket 2023-10-17 10:26:03 +02:00
b22f1260bf bump strois to a temporary version while we wait for rusty_s3 to do a new release prototype-zookeeper-ha-6 2023-10-13 11:04:12 +02:00
dfb84f80da bump strois version prototype-zookeeper-ha-5 2023-10-10 19:25:12 +02:00
98b67f217a move to our new S3 lib prototype-zookeeper-ha-4 2023-09-28 11:24:18 +02:00
6325cda74f bump charabia prototype-zookeeper-ha-3 2023-09-21 15:18:44 +02:00
c71ba72f73 fix build in release mode prototype-zookeeper-ha-2 2023-09-21 11:05:57 +02:00
ecd36b15f0 exposes all the s3 arguments prototype-zookeeper-ha-1 2023-09-13 18:17:56 +02:00
8a2e8a887f Load the latest snapshot when we start the engine 2023-09-12 18:08:24 +02:00
309c33a418 Fix again the dots 2023-09-12 17:55:01 +02:00
9b01506cee Move the load snapshot step into a function 2023-09-12 16:05:02 +02:00
f37fdceb15 Use slashes instead of dots for the s3 paths separators 2023-09-12 15:46:15 +02:00
f544cfa444 Remove tasks and content file on the s3 2023-09-12 15:19:45 +02:00
c158d03337 Fix internal error 2023-09-12 14:46:13 +02:00
b7109c0fd2 start a script to run everything 2023-09-12 11:34:59 +02:00
a53a0fdb77 Store content files into the S3 2023-09-11 18:17:22 +02:00
719fdd701b Fix and crash when the tasks path is unknown 2023-09-07 11:31:18 +02:00
01c13c98ac Mastering minio 2023-09-06 17:54:21 +02:00
5b89276fcc starts using s3 2023-09-05 19:25:09 +02:00
41697c4d65 Introduce the zk-tasks folder 2023-09-04 18:24:34 +02:00
7d85753573 Make the snapshot download work 2023-09-04 17:38:56 +02:00
76657af1f9 Add the options into the IndexScheduler 2023-09-04 16:38:05 +02:00
966cbdab69 make the tests compile again 2023-09-04 15:39:54 +02:00
0c68b9ed4c WIP making the final snapshot swap 2023-08-31 15:56:42 +02:00
d7233ecdb8 Make things to compile again 2023-08-31 14:55:14 +02:00
95a011af13 Wrap the IndexScheduler fields into an inner struct 2023-08-31 10:36:33 +02:00
e257710961 WIP fix the tests 2023-08-30 18:03:24 +02:00
9dd4423054 Fix the watcher ordering of the auth/ node 2023-08-30 17:51:22 +02:00
8c3ad57ef9 React to changes towards the cluster members 2023-08-30 17:40:12 +02:00
2d1434da81 Keep the ZK flow when enqueuing tasks 2023-08-30 17:15:15 +02:00
c488a4a351 Fixup a lot of small issues on the ZK config 2023-08-30 16:42:55 +02:00
0c7d7c68bc WIP moving to the sync zookeeper API 2023-08-30 15:06:12 +02:00
854745c670 wip: starts working on importing the snapshots 2023-08-16 18:41:05 +02:00
777eebb759 starts creating snapshot, the import is still missing 2023-08-10 15:00:25 +02:00
61ccfaf9bc wake up after registering a task 2023-08-10 09:39:39 +02:00
f0c4d36ff7 implement the deletion of tasks after processing a batch
add a lot of comments and logs
2023-08-10 09:36:43 +02:00
8c20d6e2fe fix the leader election 2023-08-09 17:23:13 +02:00
8e437ed76c Start leader election and task processing (WIP) 2023-08-09 16:52:38 +02:00
1191ec5939 fix the register task watcher 2023-08-08 13:18:55 +02:00
0d20d08daf fix a few warnings 2023-08-08 11:39:48 +02:00
b66bf049b5 Create a task on zookeeper side when a task is created locally 2023-08-07 17:02:51 +02:00
b2f36b9b97 Comment Meilisearch container by default 2023-08-07 17:02:00 +02:00
b311089435 Update zookeeper client 2023-08-07 14:20:01 +02:00
3d46e84d97 update docker compose as an example 2023-08-03 17:15:24 +02:00
ad7f8edff8 fix auto-synchronization with zk prototype-zookeeper-ha-0 2023-08-03 14:43:29 +02:00
5ce01bcb53 add logs 2023-08-03 13:59:05 +02:00
d5523cc6ac fix the tests 2023-08-03 12:28:08 +02:00