1ba46f8f77
Disable clippy rule
2021-04-27 12:43:00 +02:00
f80ea24d2b
Add tests on every platform and fix clippy errors
2021-04-27 12:42:59 +02:00
adfdb99abc
feat(http): calculate updates' and uuids' dbs size
2021-04-09 15:59:12 +03:00
ae1655586c
fixes after review
2021-04-09 14:40:48 +03:00
698a1ea582
feat(http): store processing as RwLock<Option<Uuid>> in index_actor
2021-04-09 14:34:43 +03:00
87412f63ef
feat(http): implement is_indexing for stats
2021-04-09 14:34:42 +03:00
dd9eae8c26
feat(http): stats route
2021-04-09 14:34:42 +03:00
cb23775d18
Rename pending into enqueued
2021-04-07 19:46:36 +02:00
0f2143e7fd
remove the now useless dead_code flags
2021-03-26 14:15:12 +01:00
d7c077cffb
atomic snapshot import
2021-03-25 14:48:51 +01:00
7d6ec7f3d3
resolve merge
2021-03-25 14:21:05 +01:00
f3dc853be3
Merge remote-tracking branch 'origin/main' into snapshots
2021-03-25 13:45:07 +01:00
48507460b2
add snapshot tests
2021-03-25 12:02:10 +01:00
d029464de8
fix snapshot path
2021-03-25 10:23:31 +01:00
79d09705d8
perform snapshot on startup
2021-03-25 09:35:15 +01:00
868658f3d8
Merge #109
...
109: Make updates atomic r=curquiza a=MarinPostma
Until now, the index_uid->uuid mapping was done before the update was written to disk in the case of automatic index creation. This was an issue when the update failed, and the index would still exists in the uuid resolver.
This is fixed by this pr, by first creating the update with an uuid if the index does not exist, and then register this uuid to the uuid resolver.
This is preliminary work to the implementation of snapshots (#19 ).
This pr also changes the `resolve` method on the `UuidResolver` to `get` to make it clearer.
The `create_uuid` method may be bound to disappear when the index name resolution is handled by a remote machine.
Co-authored-by: mpostma <postma.marin@protonmail.com >
2021-03-24 12:24:32 +00:00
d892a2643e
fix clippy
2021-03-24 12:38:59 +01:00
83ffdc888a
remove bad file name test
2021-03-24 12:38:59 +01:00
4041d9dc48
format code
2021-03-24 12:38:59 +01:00
1f16c8d224
integration test snapshot
2021-03-24 12:38:59 +01:00
06f9dae0f3
remove prints
2021-03-24 12:38:59 +01:00
48d5f88c1a
fix snapshot dir already exists
2021-03-24 12:38:59 +01:00
eb53ed4cc1
load snapshot
2021-03-24 12:38:59 +01:00
46293546f3
add tests and mocks
2021-03-24 12:38:59 +01:00
3cc3637e2d
refactor for tests
2021-03-24 12:38:56 +01:00
1f51fc8baf
create indexes snapshots concurrently
2021-03-24 12:38:12 +01:00
e9da191b7d
fix snapshot bugs
2021-03-24 12:38:12 +01:00
d73fbdef2e
remove from snapshot
2021-03-24 12:38:12 +01:00
44dcfe29aa
clean snapshot creation
2021-03-24 12:38:12 +01:00
a85e7abb0c
fix snapshot creation
2021-03-24 12:38:12 +01:00
4847884165
restore snapshots
2021-03-24 12:38:12 +01:00
7f6a54cb12
add lock to prevent snapshot during update
2021-03-24 12:38:12 +01:00
520f7c09ba
sequential index snapshot
2021-03-24 12:38:12 +01:00
35a7b800eb
snapshot indexes
2021-03-24 12:38:12 +01:00
c966b1dd94
use options to schedule snapshot
2021-03-24 12:38:11 +01:00
ee838be41b
implement snapshot scheduler
2021-03-24 12:38:11 +01:00
5f33672f0e
change payload send to use stream methods
2021-03-22 19:49:21 +01:00
b690f1103a
fix typos
2021-03-22 19:25:56 +01:00
147756750b
create uuid on successful update addition
...
also change resolve to get in uuid resolver
2021-03-18 09:09:26 +01:00
8b99860e85
use write sender for updates
2021-03-18 08:32:05 +01:00
ca3b343b1f
Merge #96
...
96: Check json payload on document addition r=curquiza a=MarinPostma
Check if the json payload in updates is valid. It uses a json validator to avoid allocation, and only serializes the json in case of error, to return a pretty message.
Co-authored-by: mpostma <postma.marin@protonmail.com >
2021-03-16 17:20:44 +00:00
204c743bcc
add json payload check on document addition
2021-03-16 14:28:13 +01:00
94bd14ede3
add name to index_metadata
2021-03-15 18:35:16 +01:00
dd324807f9
last review edits + fmt
2021-03-15 18:11:10 +01:00
abbea59732
fix clippy warnings
2021-03-15 16:52:05 +01:00
01479dcf99
rename name to uid in code
2021-03-15 14:43:47 +01:00
99c89cf2ba
use options max db sizes
2021-03-13 10:09:10 +01:00
49b74b587a
enable jemalloc only on linux
2021-03-12 17:47:40 +01:00
2ee2e6a9b2
clean project
2021-03-12 14:57:24 +01:00
c4846dafca
implement update index
2021-03-12 14:48:43 +01:00
