Commit Graph

280 Commits

Author SHA1 Message Date
2331d24685
reduce excessive message frag saving (queue dedup + waiting 10sec)
prepare for frag updates
2024-03-12 18:10:24 +01:00
a358052fa6
try to tame log spam 2024-03-12 18:10:24 +01:00
c758d4f2d0
fix accel structure being wrong and mark empty frags and dont count them 2024-03-12 18:10:24 +01:00
8bac5e1a3a
combat memory leaks with smart pointers 2024-03-12 18:10:24 +01:00
a4153aa087
refactor saving and save on exit 2024-03-12 18:10:23 +01:00
d239176455
dirty frag on message updates (if still open) 2024-03-12 18:10:23 +01:00
abbe3025a5
refactor message fuid -> fid
save alot of memory by using fid instead of fuid
2024-03-12 18:10:23 +01:00
e79505b82c
reduce log spam 2024-03-12 18:10:23 +01:00
e1be9674d9
remove old code 2024-03-12 18:10:23 +01:00
2bbaa80c22
forgot to throw update on read 2024-03-12 18:10:22 +01:00
22079bf37b
dont sync messages we dont know enough about 2024-03-12 18:10:22 +01:00
c43428367b
make adjacency loading work, extend range and use loops 2024-03-12 18:10:22 +01:00
13a46a45e0
replace old bad prev/next code with way better code 2024-03-12 18:10:22 +01:00
5c7d017946
smaller contact frag fixes 2024-03-12 18:10:22 +01:00
5b9876ffa5
impl new acceleration structure for components, not exploited yet
disable funky load at first msg
2024-03-12 18:10:22 +01:00
57c387ace0
forgot to check contact 2024-03-12 18:10:21 +01:00
37580b630b
rework cursers for cg, keep views between switching. will be refactored later 2024-03-12 18:10:21 +01:00
bca6d9c07a
fix one inverted comparator 2024-03-12 18:10:21 +01:00
c3169ddfe7
stop ignoring mfs interval and sort after 2024-03-12 18:10:21 +01:00
02687a37d5
make inital curser a range 2024-03-12 18:10:21 +01:00
b3c749ecac
loading logic implemented but broken (very funky and sometimes even out of contact) 2024-03-12 18:10:21 +01:00
a79db21434
load based on view cursers (untested and not used yet) 2024-03-12 18:10:20 +01:00
e864ccba5d
msg frag before and after helper 2024-03-12 18:10:20 +01:00
30eccb9bd9
fix potential tsrange errors and deduplicate state 2024-03-12 18:10:20 +01:00
708019fc51
make writing safe (by using a tmp file and moving to actual location) 2024-03-12 18:10:20 +01:00
d3e12bb6c1
make empty contacts from ids on message load 2024-03-12 18:10:20 +01:00
7dd4893a54
change binary meta format and add zstd to metadata 2024-03-12 18:10:20 +01:00
b64d0891d4
switch to streaming compressor for data to drastically improve ratio.
would still benefit from a abstract file refactor
2024-03-12 18:10:19 +01:00
cd9407955e
update fs readme a little 2024-03-12 18:10:19 +01:00
5fa24f8426
save msg json zstd compressed (3x compression) 2024-03-12 18:10:19 +01:00
6ce985b4a6
simplify array cast a little 2024-03-12 18:10:19 +01:00
2038e86f14
add zstd dep 2024-03-12 18:10:19 +01:00
e2f61fd446
comp refactor and make groups work 2024-03-12 18:10:19 +01:00
0f0a184bd4
move json around and disable files for now 2024-03-12 18:10:18 +01:00
6e110da68e
reverse message write order 2024-03-12 18:10:18 +01:00
e894de5cf4
add dup check, would work for ngc if we saved tox group msg id yet 2024-03-12 18:10:18 +01:00
9bdfa2af30
fix dup on write 2024-03-12 18:10:18 +01:00
dc16c6e3e2
basically working, but some dup glitch is still there 2024-03-12 18:10:18 +01:00
ae3fd5b782
scan laters 2024-03-12 18:10:18 +01:00
28b7b4e564
fragment events + 256bit uuids 2024-03-12 18:10:17 +01:00
6af60f9328
refactor message serializer to allow access to eg contacts 2024-03-12 18:10:17 +01:00
3258731bb1
further serializer refactoring 2024-03-12 18:10:17 +01:00
cc2a5f10ca
improve deserialization and provide message comp deserl 2024-03-12 18:10:17 +01:00
265849064a
loading fragments mostly working (not notifying anyone yet) 2024-03-12 18:10:17 +01:00
6573b221ce
add contact id to meta 2024-03-12 18:10:16 +01:00
e3ba66f712
more comps 2024-03-12 18:10:16 +01:00
9c04ce0e02
handle empty type 2024-03-12 18:10:16 +01:00
d08fe13813
dump messages to data (some comps) 2024-03-12 18:10:16 +01:00
36ba052e79
message fragment meta is saved, but still empty data 2024-03-12 18:10:16 +01:00
f2c4096f25
start with messages (no fragments get created yet) 2024-03-12 18:10:16 +01:00