|
|
31bb0d3e61
|
refactor meta data decompression using file2 and mem
|
2024-04-12 13:42:05 +02:00 |
|
|
|
248f68f6a2
|
minimal stack creation refactor (wip)
|
2024-04-12 13:42:05 +02:00 |
|
|
|
3b010bd16f
|
catch write errors (eg unsanitzed strings)
|
2024-04-12 13:42:05 +02:00 |
|
|
|
7e285290fe
|
test in memory comp
|
2024-04-12 13:42:05 +02:00 |
|
|
|
5767834f71
|
since its working, remove old commented code
|
2024-04-12 13:42:05 +02:00 |
|
|
|
53ce292e82
|
fix stack overflow (i am stupid) and some file stack error handling
|
2024-04-12 13:42:04 +02:00 |
|
|
|
84bd24807d
|
small change to flush work space. writing new frags is broken rn
|
2024-04-12 13:42:04 +02:00 |
|
|
|
8d0518c2e3
|
harden against some parsing exceptions
(by disabling them, since the error case is already handled)
|
2024-04-12 13:42:04 +02:00 |
|
|
|
6d150ba441
|
roll back meta comp (did it wrong) and enable data comp
|
2024-04-12 13:42:04 +02:00 |
|
|
|
c737715c66
|
more refactor and transition meta write
|
2024-04-12 13:42:04 +02:00 |
|
|
|
b640b5a06b
|
variant to span helper
|
2024-04-12 13:42:04 +02:00 |
|
|
|
1b9363e7b5
|
tested and works, cleaning up commented code
|
2024-04-12 13:42:03 +02:00 |
|
|
|
16d2238f35
|
fixes for ci
|
2024-04-12 13:42:03 +02:00 |
|
|
|
19844a9423
|
use file2 zstd wrapper to read frag data (untested)
|
2024-04-12 13:42:03 +02:00 |
|
|
|
19fd99f713
|
refactor out uuidgenerator
|
2024-04-12 13:42:03 +02:00 |
|
|
|
f22f523774
|
minor frag store refactor
|
2024-04-12 13:42:03 +02:00 |
|
|
|
8b17ed195f
|
more testing and file2 zstd now passes tests with varying frame sizes
and 1.5gig files
|
2024-04-12 13:42:03 +02:00 |
|
|
|
def7fc1959
|
add file2 impl for zstd (lightly tested and not integrated yet)
|
2024-04-12 13:42:02 +02:00 |
|
|
|
318be9cd62
|
throw update
|
2024-04-12 13:42:02 +02:00 |
|
|
|
2772c8ee69
|
reduce excessive message frag saving (queue dedup + waiting 10sec)
prepare for frag updates
|
2024-04-12 13:42:02 +02:00 |
|
|
|
eac2927379
|
try to tame log spam
|
2024-04-12 13:42:02 +02:00 |
|
|
|
77a0ae6acd
|
fix accel structure being wrong and mark empty frags and dont count them
|
2024-04-12 13:42:02 +02:00 |
|
|
|
7879a0927b
|
combat memory leaks with smart pointers
|
2024-04-12 13:42:02 +02:00 |
|
|
|
88ea3e177d
|
refactor saving and save on exit
|
2024-04-12 13:42:01 +02:00 |
|
|
|
bc22451524
|
dirty frag on message updates (if still open)
|
2024-04-12 13:42:01 +02:00 |
|
|
|
7b8e93eec3
|
refactor message fuid -> fid
save alot of memory by using fid instead of fuid
|
2024-04-12 13:42:01 +02:00 |
|
|
|
71be5c3c6e
|
reduce log spam
|
2024-04-12 13:42:01 +02:00 |
|
|
|
2b8cee6a29
|
remove old code
|
2024-04-12 13:42:01 +02:00 |
|
|
|
5bf4640d61
|
forgot to throw update on read
|
2024-04-12 13:42:01 +02:00 |
|
|
|
0e0e81720b
|
dont sync messages we dont know enough about
|
2024-04-12 13:42:00 +02:00 |
|
|
|
592a4cb9cf
|
make adjacency loading work, extend range and use loops
|
2024-04-12 13:42:00 +02:00 |
|
|
|
93f60bd073
|
replace old bad prev/next code with way better code
|
2024-04-12 13:42:00 +02:00 |
|
|
|
6a6de77ae9
|
smaller contact frag fixes
|
2024-04-12 13:42:00 +02:00 |
|
|
|
89f065a610
|
impl new acceleration structure for components, not exploited yet
disable funky load at first msg
|
2024-04-12 13:42:00 +02:00 |
|
|
|
52e95ca654
|
forgot to check contact
|
2024-04-12 13:41:59 +02:00 |
|
|
|
eaa316a2aa
|
rework cursers for cg, keep views between switching. will be refactored later
|
2024-04-12 13:41:59 +02:00 |
|
|
|
bdf4e60f2f
|
fix one inverted comparator
|
2024-04-12 13:41:59 +02:00 |
|
|
|
2e3c779bec
|
stop ignoring mfs interval and sort after
|
2024-04-12 13:41:59 +02:00 |
|
|
|
461a4f1aa7
|
make inital curser a range
|
2024-04-12 13:41:59 +02:00 |
|
|
|
78488daa9b
|
loading logic implemented but broken (very funky and sometimes even out of contact)
|
2024-04-12 13:41:59 +02:00 |
|
|
|
22f2c8f514
|
load based on view cursers (untested and not used yet)
|
2024-04-12 13:41:58 +02:00 |
|
|
|
e442191aad
|
msg frag before and after helper
|
2024-04-12 13:41:58 +02:00 |
|
|
|
795ab2d4e1
|
fix potential tsrange errors and deduplicate state
|
2024-04-12 13:41:58 +02:00 |
|
|
|
0896038dd6
|
make writing safe (by using a tmp file and moving to actual location)
|
2024-04-12 13:41:58 +02:00 |
|
|
|
67c6f9adb0
|
make empty contacts from ids on message load
|
2024-04-12 13:41:58 +02:00 |
|
|
|
6aac44cda9
|
change binary meta format and add zstd to metadata
|
2024-04-12 13:41:58 +02:00 |
|
|
|
4fb2b51b7d
|
switch to streaming compressor for data to drastically improve ratio.
would still benefit from a abstract file refactor
|
2024-04-12 13:41:57 +02:00 |
|
|
|
182d844e32
|
update fs readme a little
|
2024-04-12 13:41:57 +02:00 |
|
|
|
6f511016bc
|
save msg json zstd compressed (3x compression)
|
2024-04-12 13:41:57 +02:00 |
|
|
|
fb885b5c21
|
simplify array cast a little
|
2024-04-12 13:41:57 +02:00 |
|
