Green Sky
aae086cc65
b03b571272 fix: flaky tcp test This only fixes the symptoms, not the real problem. Sometimes or consistently on some platforms a socket might need a moment before it can be written to.
32e67ab4c2 cleanup: use typedef for private message ID's in callback
7b1db6adc1 feat: add message IDs to private group messages
99e0bcc27d refactor: Observers/ignored peers can now send and receive custom packets
b3c3c49d26 fix: Disable IPv6 in Windows cross-compilation tests
e742deddff feat: Check hashes of Windows dependencies when cross-compiling
dfb9a0b02b fix: Test the current Windows Dockerfile, not an old Dockerhub image
14de93ccec chore: Use WineHQ's Wine as Debian Bookworm's crashes
ed37616249 docs: Update the Windows cross-compilation section
9bb79c174f cleanup: Remove a couple of unnecessary misc_tools dependencies
19475adb70 chore: Statically link OpenMP into the cracker fun util on Windows
1be311e51f feat: Build the fun utils when cross-compiling to Windows
88133f8446 chore: Strip Windows binaries
3cc0ae7535 refactor: Copy over all of the required static dependencies
c4fa8f7fb1 feat: Generate .def, .exp and .lib files when building for Windows
74bbac5363 feat: Let CMake create the dll instead of doing so ourselves
246642e9ae feat: Harden Windows cross-compilation
8d431c0d11 chore: Bump Windows build dependency versions
e519f7998b fix: Remove unnecessary wsock32 dependency on Windows
ed2b60c217 chore: Use a specific non-broken slimcc version.
d7f21010a1 chore: Update github actions.
e71a68b7f2 docs: Update the list of CMake options
77e08876ff chore: Remove mod and founder from group API naming scheme
12bc042767 docs: add the experimental api build option to INSTALL.md
e1fa5cae96 refactor: Rename Queries to Query to align with other enums.
be82a3ea30 fix: Correct type for conference offline peer numbers.
0627c36716 test: Add pkgsrc build.
92578afe4b test: Add FreeBSD VM action on GitHub.
52ece0f57b test: Build toxcore on NetBSD (VM).
3fe8ee2c11 chore: Only install tox_private.h on request.
9a8dfa06ab fix: save_compatibility_test failing on big-endian systems
86f5e55578 fix: Don't serve files from websockify.
710eb674a5 fix: Correctly pass extended public keys to group moderation code.
021db7031c refactor: Use `struct`s for extended public/secret keys.
a1e999fd80 chore: Compile libsodium reference implementation with compcert.
fbe3c19cf5 cleanup: correct a few nullable annotations
623e3ee5c3 cleanup: Don't use `memcpy` to cast arbitrary `struct`s to `uint8_t[]`.
c71567dc18 fix: Pass array, not array pointer, to `memcmp`.
9b46a08144 cleanup: Never pass `void*` directly to `memcpy`.
5d7b7a7bbc refactor: Use tox rng to seed the keypair generation.
961891d568 cleanup: Small improvements found by PVS Studio.
8201019f0d chore: Disable NGC saving by default, enable through Tox_Options.
5dd9ee3f65 cleanup: Replace pointer arithmetic with explicit `&arr[i]`.
ca4606d49d refactor: Use strong typedef for NGC peer id.
442213b722 cleanup: Simplify custom packet length check in NGC.
08d3393def fix: Correct a few potential null derefs in bootstrap daemon.
b9877b32b0 fix: Add missing memunlock of local variable when it goes out of scope.
dab5fe44b9 fix: Zero out stack-allocated secret key before return.
f058103299 refactor: Make prune_gc_sanctions_list more obviously correct.
3ba7a0dec9 docs: Add static analysis tool list to README.
8d0811a0f3 docs: Run prettier-markdown on markdown files.
969e3a2bfc refactor: Fix network test not using the strong typedef
93c83fbc7c refactor: Use strong typedef instead of struct for `Socket`.
9fe18b176f fix: Fix some false positive from PVS Studio.
7c44379ccb cleanup: Check that WINXP macro exists before comparing it.
5c93231bef refactor: Make tox mutex non-recursive.
aacff73939 docs: Fix up doxyfile.
d55fc85ff5 docs: Add more documentation to crypto_core.
5bdaaaedb6 refactor: Remove `Tox *` from `tox_dispatch`.
e202341e76 refactor: Don't rely on tox_dispatch passing tox in tests.
34df938f52 chore: Use C++ mode for clang-tidy.
8b05296a78 chore: Check that both gtest and gmock exist for tests.
42010660e1 test: Add slimcc compiler compatibility test.
b473630321 chore: Add some comments to the astyle config.
b7404f24f6 cleanup: Remove implicit bool conversions.
4e2dba4d9f chore: Reformat sources with astyle.
4359e3a6bc chore: Rename C++ headers to .hh suffixes.
0c05566e58 cleanup: Further `#include` cleanups.
8d29935b7a chore: Only check the bootstrap daemon checksum on release.
f70e588bc6 cleanup: Add more `const` where possible.
511bfe39c8 cleanup: Use Bazel modules to enforce proper `#include` hygiene.
1710a0d091 refactor: Move pack/unpack `IP_Port` from DHT into network module.
a975943564 chore: Really fix coverage docker image build.
c08409390f chore: Fix post-submit coverage image.
39aadf8922 fix: Don't use `memcmp` to compare `IP_Port`s.
d94246a906 fix: partially fix a bug that prevented group part messages from sending.
eeaa039222 chore: Fix rpm build; add a CI check for it.
8328449c1a chore: Speed up docker builds a bit by reducing layer count.
d6d67d56f3 cleanup: Add `const` where possible in auto tests.
6aa9e6850d cleanup: Minor cleanup of event unpack code.
bdf460a3a9 refactor: Rename `system_{memory,...}` to `os_{memory,...}`.
203e1af81e fix: a few off by one errors in group autotests
5c093c4888 cleanup: Remove all uses of `SIZEOF_VLA`.
662c2140f3 test: Add goblint static analyser.
8f07755834 cleanup: Use `memzero(x, s)` instead of `memset(x, 0, s)`.
a7258e40cf cleanup: Use explicit 0 instead of `PACKET_ID_PADDING`.
6370d0f15d cleanup: Expand the `Tox_Options` accessor macros.
14a1a0b9bd cleanup: Remove plan9 support.
a05dccad13 test: Add a simple new/delete test for Tox.
1cdcf938b9 cleanup: Add comment after every `#endif`.
ba99d4dc4b test: Fix comment I broke in the events test PR.
e07248debb refactor: Migrate auto_tests to new events API.
bdd42b5452 refactor: Add common msgpack array packer with callback.
3c659f5288 cleanup: Rename group to conference in groupav documentation.
89957be230 cleanup: Ensure handler params are named after callback params.
c650d9d345 refactor: Pass `this` pointer as first param to s11n callbacks.
e7fb91ddb8 refactor: Allow NULL pointers for byte arrays in events.
5e2c8cabc1 cleanup: make some improvements to group moderation test
259de4867e cleanup: Remove `bin_pack_{new,free}`.
21a8ff5895 cleanup: skip a do_gc iteration before removing peers marked for deletion
16809dc36e feat: Add dht_get_nodes_response event to the events system.
git-subtree-dir: external/toxcore/c-toxcore
git-subtree-split: b03b5712720de9a9901ea12fd741f177327a7021
204 lines
8.6 KiB
C
204 lines
8.6 KiB
C
/* SPDX-License-Identifier: GPL-3.0-or-later
|
|
* Copyright © 2022 The TokTok team.
|
|
*/
|
|
#ifndef C_TOXCORE_TOXCORE_BIN_PACK_H
|
|
#define C_TOXCORE_TOXCORE_BIN_PACK_H
|
|
|
|
#include <stdbool.h>
|
|
#include <stdint.h>
|
|
|
|
#include "attributes.h"
|
|
#include "logger.h"
|
|
|
|
#ifdef __cplusplus
|
|
extern "C" {
|
|
#endif
|
|
|
|
/**
|
|
* @brief Binary serialisation object.
|
|
*
|
|
* Naming convention:
|
|
* - Functions ending in `_b` (or `_b_size`) are NOT MessagePack, i.e. write
|
|
* data in plain big endian binary format.
|
|
* - All other functions encode their input in MessagePack format.
|
|
*
|
|
* Some notes on parameter order:
|
|
*
|
|
* - We pass the `obj` pointer as `this`-like pointer first to the callbacks.
|
|
* - Any extra arguments passed to the callback follow the `obj` (and in case of
|
|
* array packing, the `arr` and `arr_size` parameters).
|
|
* - The packer is passed last.
|
|
*
|
|
* This roughly matches a curried lambda function:
|
|
*
|
|
* @code
|
|
* bin_pack_obj([](const void *obj, const Logger *logger, Bin_Pack *bp) { ... }, obj, logger, buf, buf_size);
|
|
* // Translates roughly to:
|
|
* bin_pack_obj([obj, logger](Bin_Pack *bp) { ... }, buf, buf_size);
|
|
* @endcode
|
|
*/
|
|
typedef struct Bin_Pack Bin_Pack;
|
|
|
|
/** @brief Function used to pack an object.
|
|
*
|
|
* This function would typically cast the `void *` to the actual object pointer type and then call
|
|
* more appropriately typed packing functions.
|
|
*/
|
|
typedef bool bin_pack_cb(const void *obj, const Logger *logger, Bin_Pack *bp);
|
|
|
|
/** @brief Function used to pack an array of objects.
|
|
*
|
|
* This function would typically cast the `void *` to the actual object pointer type and then call
|
|
* more appropriately typed packing functions.
|
|
*
|
|
* @param arr is the object array as void pointer.
|
|
* @param index is the index in the object array that is currently being packed.
|
|
*/
|
|
typedef bool bin_pack_array_cb(const void *arr, uint32_t index, const Logger *logger, Bin_Pack *bp);
|
|
|
|
/** @brief Determine the serialised size of an object.
|
|
*
|
|
* @param callback The function called on the created packer and packed object.
|
|
* @param obj The object to be packed, passed as `obj` to the callback.
|
|
* @param logger Optional logger object to pass to the callback.
|
|
*
|
|
* @return The packed size of the passed object according to the callback.
|
|
* @retval UINT32_MAX in case of errors such as buffer overflow.
|
|
*/
|
|
non_null(1) nullable(2, 3)
|
|
uint32_t bin_pack_obj_size(bin_pack_cb *callback, const void *obj, const Logger *logger);
|
|
|
|
/** @brief Pack an object into a buffer of a given size.
|
|
*
|
|
* This function creates and initialises a `Bin_Pack` packer object, calls the callback with the
|
|
* packer object and the to-be-packed object, and then cleans up the packer object. Note that
|
|
* there is nothing MessagePack-specific about this function, so it can be used for both custom
|
|
* binary and MessagePack formats.
|
|
*
|
|
* You can use `bin_pack_obj_size` to determine the minimum required size of `buf`. If packing
|
|
* overflows `uint32_t`, this function returns `false`.
|
|
*
|
|
* Passing NULL for `obj` is supported, but requires that the callback supports nullable inputs.
|
|
*
|
|
* @param callback The function called on the created packer and packed object.
|
|
* @param obj The object to be packed, passed as `obj` to the callback.
|
|
* @param logger Optional logger object to pass to the callback.
|
|
* @param buf A byte array large enough to hold the serialised representation of `obj`.
|
|
* @param buf_size The size of the byte array. Can be `UINT32_MAX` to disable bounds checking.
|
|
*
|
|
* @retval false if an error occurred (e.g. buffer overflow).
|
|
*/
|
|
non_null(1, 4) nullable(2, 3)
|
|
bool bin_pack_obj(bin_pack_cb *callback, const void *obj, const Logger *logger, uint8_t *buf, uint32_t buf_size);
|
|
|
|
/** @brief Determine the serialised size of an object array.
|
|
*
|
|
* Behaves exactly like `bin_pack_obj_b_array` but doesn't write.
|
|
*
|
|
* @param callback The function called on the created packer and each object to
|
|
* be packed.
|
|
* @param arr The object array to be packed, passed as `arr` to the callback.
|
|
* @param arr_size The number of elements in the object array.
|
|
* @param logger Optional logger object to pass to the callback.
|
|
*
|
|
* @return The packed size of the passed object array according to the callback.
|
|
* @retval UINT32_MAX in case of errors such as buffer overflow.
|
|
*/
|
|
non_null(1) nullable(2, 4)
|
|
uint32_t bin_pack_obj_array_b_size(bin_pack_array_cb *callback, const void *arr, uint32_t arr_size, const Logger *logger);
|
|
|
|
/** @brief Pack an object array into a buffer of a given size.
|
|
*
|
|
* Similar to `bin_pack_obj_array` but does not write the array length, so
|
|
* if you need that, encoding it is on you.
|
|
*
|
|
* Passing NULL for `arr` has no effect, but requires that `arr_size` is 0.
|
|
*
|
|
* @param callback The function called on the created packer and packed object
|
|
* array.
|
|
* @param arr The object array to be packed, passed as `arr` to the callback.
|
|
* @param arr_size The number of elements in the object array.
|
|
* @param logger Optional logger object to pass to the callback.
|
|
* @param buf A byte array large enough to hold the serialised representation of `arr`.
|
|
* @param buf_size The size of the byte array. Can be `UINT32_MAX` to disable bounds checking.
|
|
*
|
|
* @retval false if an error occurred (e.g. buffer overflow).
|
|
*/
|
|
non_null(1, 5) nullable(2, 4)
|
|
bool bin_pack_obj_array_b(bin_pack_array_cb *callback, const void *arr, uint32_t arr_size, const Logger *logger, uint8_t *buf, uint32_t buf_size);
|
|
|
|
/** @brief Encode an object array as MessagePack array into a bin packer.
|
|
*
|
|
* Calls the callback `arr_size` times with increasing `index` argument from 0 to
|
|
* `arr_size`. This function is here just so we don't need to write the same
|
|
* trivial loop many times and so we don't need an extra struct just to contain
|
|
* an array with size so it can be passed to `bin_pack_obj`.
|
|
*
|
|
* Similar to `bin_pack_obj` but for arrays. Note that a `Bin_Pack` object is
|
|
* required here, so it must be called from within a callback to one of the
|
|
* functions above.
|
|
*
|
|
* Passing NULL for `arr` requires that `arr_size` is 0. This will write a 0-size
|
|
* MessagePack array to the packer.
|
|
*
|
|
* @param bp Bin packer object.
|
|
* @param callback The function called on the created packer and packed object
|
|
* array.
|
|
* @param arr The object array to be packed, passed as `arr` to the callback.
|
|
* @param arr_size The number of elements in the object array.
|
|
* @param logger Optional logger object to pass to the callback.
|
|
*
|
|
* @retval false if an error occurred (e.g. buffer overflow).
|
|
*/
|
|
non_null(1, 2) nullable(3, 5)
|
|
bool bin_pack_obj_array(Bin_Pack *bp, bin_pack_array_cb *callback, const void *arr, uint32_t arr_size, const Logger *logger);
|
|
|
|
/** @brief Start packing a MessagePack array.
|
|
*
|
|
* A call to this function must be followed by exactly `size` calls to other functions below.
|
|
*/
|
|
non_null()
|
|
bool bin_pack_array(Bin_Pack *bp, uint32_t size);
|
|
|
|
/** @brief Pack a MessagePack bool. */
|
|
non_null() bool bin_pack_bool(Bin_Pack *bp, bool val);
|
|
/** @brief Pack a `uint8_t` as MessagePack positive integer. */
|
|
non_null() bool bin_pack_u08(Bin_Pack *bp, uint8_t val);
|
|
/** @brief Pack a `uint16_t` as MessagePack positive integer. */
|
|
non_null() bool bin_pack_u16(Bin_Pack *bp, uint16_t val);
|
|
/** @brief Pack a `uint32_t` as MessagePack positive integer. */
|
|
non_null() bool bin_pack_u32(Bin_Pack *bp, uint32_t val);
|
|
/** @brief Pack a `uint64_t` as MessagePack positive integer. */
|
|
non_null() bool bin_pack_u64(Bin_Pack *bp, uint64_t val);
|
|
/** @brief Pack an empty array member as a MessagePack nil value. */
|
|
non_null() bool bin_pack_nil(Bin_Pack *bp);
|
|
/** @brief Pack a byte array as MessagePack bin. */
|
|
non_null() bool bin_pack_bin(Bin_Pack *bp, const uint8_t *data, uint32_t length);
|
|
/** @brief Start packing a custom binary representation.
|
|
*
|
|
* A call to this function must be followed by exactly `size` bytes packed by functions below.
|
|
*/
|
|
non_null() bool bin_pack_bin_marker(Bin_Pack *bp, uint32_t size);
|
|
|
|
/** @brief Write a `uint8_t` directly to the packer in 1 byte. */
|
|
non_null() bool bin_pack_u08_b(Bin_Pack *bp, uint8_t val);
|
|
/** @brief Write a `uint16_t` as big endian 16 bit int in 2 bytes. */
|
|
non_null() bool bin_pack_u16_b(Bin_Pack *bp, uint16_t val);
|
|
/** @brief Write a `uint32_t` as big endian 32 bit int in 4 bytes. */
|
|
non_null() bool bin_pack_u32_b(Bin_Pack *bp, uint32_t val);
|
|
/** @brief Write a `uint64_t` as big endian 64 bit int in 8 bytes. */
|
|
non_null() bool bin_pack_u64_b(Bin_Pack *bp, uint64_t val);
|
|
|
|
/** @brief Write a byte array directly to the packer in `length` bytes.
|
|
*
|
|
* Note that unless you prepend the array length manually, there is no record of it in the resulting
|
|
* serialised representation.
|
|
*/
|
|
non_null() bool bin_pack_bin_b(Bin_Pack *bp, const uint8_t *data, uint32_t length);
|
|
|
|
#ifdef __cplusplus
|
|
} /* extern "C" */
|
|
#endif
|
|
|
|
#endif /* C_TOXCORE_TOXCORE_BIN_PACK_H */
|