tomato-testing/INSTALL.md
Green Sky 47ad96e2b6 Squashed 'external/toxcore/c-toxcore/' changes from 3e05824b80..da438763d5
da438763d5 chore: Release 0.2.19
f90417987c chore: Add cmake flag to disable unit tests.
7df3f99417 docs: Document that group topic lock is default on.
9e9ed77390 docs: Add missing param docs for callbacks.
0ec4978de5 refactor: Don't expose Tox_System in the public API
a3d1b8595c docs: Public headers, Core/toxcore -> Tox/the Tox library
f78d0f3f39 docs: Public headers, events_alloc -> internal
817518949e docs: Public headers, NULL-terminated -> NUL-terminated
be085db191 docs: Public headers, spellcheck
4c902955f3 docs: Public headers, 80 column width comments
be8a82a818 docs: Public headers, null -> NULL
419d783d95 docs: Public headers, tox -> Tox
5c8aa65e41 docs: Update user data API explanation
ad4921dbaa cleanup: A more descriptive error for group invite accept function

git-subtree-dir: external/toxcore/c-toxcore
git-subtree-split: da438763d5b8e071de6e061a1dcaddd2177dff7d
2024-03-28 16:13:51 +01:00

26 KiB

Installation instructions

These instructions will guide you through the process of building and installing the toxcore library and its components, as well as getting already pre-built binaries.

Table of contents

Overview

Components

Main

This repository, although called toxcore, in fact contains several libraries besides toxcore which complement it, as well as several executables. However, note that although these are separate libraries, at the moment, when building the libraries, they are all merged into a single toxcore library. Here is the full list of the main components that can be built using the CMake, their dependencies and descriptions.

Name Type Dependencies Platform Description
toxcore Library libsodium, libm, libpthread, librt Cross-platform The main Tox library that provides the messenger functionality.
toxav Library libtoxcore, libopus, libvpx Cross-platform Provides audio/video functionality.
toxencryptsave Library libtoxcore, libsodium Cross-platform Provides encryption of Tox profiles (savedata), as well as arbitrary data.
DHT_bootstrap Executable libtoxcore Cross-platform A simple DHT bootstrap node.
tox-bootstrapd Executable libtoxcore, libconfig Unix-like Highly configurable DHT bootstrap node daemon (systemd, SysVinit, Docker).
cmp Library Cross-platform C implementation of the MessagePack serialization format. https://github.com/camgunz/cmp

Secondary

There are some programs that are not built by default which you might find interesting. You need to pass -DBUILD_FUN_UTILS=ON to cmake to build them.

Vanity key generators

Can be used to generate vanity Tox Ids or DHT bootstrap node public keys.

Name Type Dependencies Platform Description
cracker Executable libsodium, OpenMP Cross-platform Tries to find a curve25519 key pair, hex representation of the public key of which starts with a specified byte sequence. Multi-threaded.
cracker_simple Executable libsodium Cross-platform Tries to find a curve25519 key pair, hex representation of the public key of which starts with a specified byte sequence. Single-threaded.
strkey Executable libsodium Cross-platform Tries to find a curve25519 key pair, hex representation of the public key of which contains a specified byte sequence at a specified or any position at all. Single-threaded.
Key file generators

Useful for generating Tox profiles from the output of the vanity key generators, as well as generating random Tox profiles.

Name Type Dependencies Platform Description
make-funny-savefile Script python Cross-platform Generates a Tox profile file (savedata file) with the provided key pair.
create_bootstrap_keys Executable libsodium Cross-platform Generates a keys file for tox-bootstrapd with either the provided or a random key pair.
create_minimal_savedata Executable libsodium Cross-platform Generates a minimal Tox profile file (savedata file) with either the provided or a random key pair, printing the generated Tox Id and secret & public key information.
create_savedata Executable libsodium, libtoxcore Cross-platform Generates a Tox profile file (savedata file) with either the provided or a random key pair using libtoxcore, printing the generated Tox Id and secret & public key information.
save-generator Executable libtoxcore Cross-platform Generates a Tox profile file (savedata file) with a random key pair using libtoxcore, setting the specified user name, going online and adding specified Tox Ids as friends.
Other
Name Type Dependencies Platform Description
bootstrap_node_info Script python3 Cross-platform Prints version and Message Of The Day (MOTD) information of the specified DHT bootstrap node, given the node doesn't have those disabled.
sign Executable libsodium Cross-platform Signs a file with a ed25519 key.

Building

Requirements

Library dependencies

Library dependencies are listed in the components table. The dependencies need to be satisfied for the components to be built. Note that if you don't have a dependency for some component, e.g. you don't have libopus installed required for building toxav component, building of that component is silently disabled.

Be advised that due to the addition of cmp as a submodule, you now also need to initialize the git submodules required by toxcore. This can be done by cloning the repo with the addition of --recurse-submodules or by running git submodule update --init in the root directory of the repo.

Compiler requirements

The supported compilers are GCC, Clang and MinGW.

In theory, any compiler that fully supports C99 and accepts GCC flags should work.

There is a partial and experimental support of Microsoft Visual C++ compiler. We welcome any patches that help improve it.

You should have a C99 compatible compiler in order to build the main components. The secondary components might require the compiler to support GNU extensions.

Build system requirements

To build the main components you need to have CMake of at least 2.8.6 version installed. You also need to have pkg-config installed, the build system uses it to find dependency libraries.

There is some experimental accommodation for building natively on Windows, i.e. without having to use MSYS/Cygwin and pkg-config, but it uses exact hardcoded paths for finding libraries and supports building only of some of toxcore components, so your mileage might vary.

CMake options

There are some options that are available to configure the build.

Name Description Expected Value Default Value
AUTOTEST Enable autotests (mainly for CI). ON or OFF OFF
BOOTSTRAP_DAEMON Enable building of tox-bootstrapd, the DHT bootstrap node daemon. For Unix-like systems only. ON or OFF ON
BUILD_FUN_UTILS Build additional just for fun utilities. ON or OFF OFF
BUILD_FUZZ_TESTS Build fuzzing harnesses. ON or OFF OFF
BUILD_MISC_TESTS Build additional tests. ON or OFF OFF
BUILD_TOXAV Whether to build the toxav library. ON or OFF ON
CMAKE_BUILD_TYPE Specifies the build type on single-configuration generators (e.g. make or ninja). Debug, Release, RelWithDebInfo, MinSizeRel Empty string.
CMAKE_INSTALL_PREFIX Path to where everything should be installed. Directory path. Platform-dependent. Refer to CMake documentation.
DHT_BOOTSTRAP Enable building of DHT_bootstrap. ON or OFF ON
ENABLE_SHARED Build shared (dynamic) libraries for all modules. ON or OFF ON
ENABLE_STATIC Build static libraries for all modules. ON or OFF ON
EXPERIMENTAL_API Install experimental header file with unstable API. ON or OFF OFF
FLAT_OUTPUT_STRUCTURE Whether to produce output artifacts in {bin,lib}. ON or OFF OFF
FULLY_STATIC Build fully static executables. ON or OFF OFF
MIN_LOGGER_LEVEL Logging level to use. TRACE, DEBUG, INFO, WARNING, ERROR or nothing (empty string) for default. Empty string.
MSVC_STATIC_SODIUM Whether to link libsodium statically for MSVC. ON or OFF OFF
MUST_BUILD_TOXAV Fail the build if toxav cannot be built. ON or OFF OFF
NON_HERMETIC_TESTS Whether to build and run tests that depend on an internet connection. ON or OFF OFF
PROXY_TEST Enable proxy test (requires other/proxy/proxy_server.go to be running). ON or OFF OFF
STRICT_ABI Enforce strict ABI export in dynamic libraries. ON or OFF OFF
TEST_TIMEOUT_SECONDS Limit runtime of each test to the number of seconds specified. Positive number or nothing (empty string). Empty string.
UNITTEST Enable unit tests (disable if you don't have a working gmock or gtest). ON or OFF ON
USE_IPV6 Use IPv6 in tests. ON or OFF ON

You can get this list of option using the following commands

cmake -B _build -LAH

or

grep "option(" CMakeLists.txt cmake/*
grep "set(.* CACHE" CMakeLists.txt cmake/*

Note that some options might be considered only if other options are enabled.

Example of calling cmake with options

cmake \
  -D ENABLE_STATIC=OFF \
  -D ENABLE_SHARED=ON \
  -D CMAKE_INSTALL_PREFIX="${PWD}/prefix" \
  -D CMAKE_BUILD_TYPE=Release \
  -D TEST_TIMEOUT_SECONDS=120 \
  ..

Building tests

In addition to the integration tests ("autotests") and miscellaneous tests enabled by cmake variables described above, there are unit tests which will be built if the source distribution of gtest (the Google Unit Test framework) is found by cmake in c-toxcore/third_party. This can be achieved by running 'git clone https://github.com/google/googletest` from that directory.

Build process

Unix-like

Assuming all the requirements are met, just run

mkdir _build
cd _build
cmake ..
make
make install

or shorter

cmake -B _build
cmake -B _build --target install

Windows

Building on Windows host
Microsoft Visual Studio's Developer Command Prompt

In addition to meeting the requirements, you need a version of Visual Studio (the community edition is enough) and a CMake version that's compatible with the Visual Studio version you're using.

You must also ensure that the msvc versions of dependencies you're using are placed in the correct folders.

For libsodium that is c-toxcore/third_party/libsodium, and for pthreads-w32, it's c-toxcore/third_party/pthreads-win32

Once all of this is done, from the Developer Command Prompt for VS, simply run

mkdir _build
cd _build
cmake ..
msbuild ALL_BUILD.vcxproj
MSYS/Cygwin

Download Cygwin (32-bit/64-bit)

Search and select exactly these packages in Devel category:

  • mingw64-i686-gcc-core (32-bit) / mingw64-x86_64-gcc-core (64-bit)
  • mingw64-i686-gcc-g++ (32-bit) / mingw64-x86_64-gcc-g++ (64-bit)
  • make
  • cmake
  • libtool
  • autoconf
  • automake
  • tree
  • curl
  • perl
  • yasm
  • pkg-config

To handle Windows EOL correctly run the following in the Cygwin Terminal:

echo '
export SHELLOPTS
set -o igncr
' > ~/.bash_profile

Download toxcore source code and extract it to a folder.

Open Cygwin Terminal in the toxcore folder and run ./other/windows_build_script_toxcore.sh to start the build process.

Toxcore build result files will appear in /root/prefix/ relatively to Cygwin folder (default C:\cygwin64).

Dependency versions can be customized in ./other/windows_build_script_toxcore.sh and described in the section below.

Cross-compiling from Linux

These cross-compilation instructions were tested on and written for 64-bit Ubuntu 16.04. You could generalize them for any Linux system, the only requirements are that you have Docker version of >= 1.9.0 and you are running 64-bit system.

The cross-compilation is fully automated by a parameterized Dockerfile.

Install Docker

apt-get update
apt-get install docker.io

Get the toxcore source code and navigate to other/docker/windows.

Build the container image based on the Dockerfile. The following options are available to customize the building of the container image.

Name Description Expected Value Default Value
SUPPORT_ARCH_i686 Support building 32-bit toxcore. "true" or "false" (case sensitive). true
SUPPORT_ARCH_x86_64 Support building 64-bit toxcore. "true" or "false" (case sensitive). true
SUPPORT_TEST Support running toxcore automated tests. "true" or "false" (case sensitive). false
VERSION_OPUS Version of libopus to build toxcore with. Numeric version number. 1.4
VERSION_SODIUM Version of libsodium to build toxcore with. Numeric version number. 1.0.19
VERSION_VPX Version of libvpx to build toxcore with. Numeric version number. 1.14.0
ENABLE_HASH_VERIFICATION Verify the hashes of the default dependency versions. "true" or "false" (case sensitive). true

Example of building a container image with options

cd other/docker/windows
docker build \
  --build-arg SUPPORT_TEST=true \
  -t toxcore \
  .

Run the container to build toxcore. The following options are available to customize the running of the container image.

Name Description Expected Value Default Value
ALLOW_TEST_FAILURE Don't stop if a test suite fails. "true" or "false" (case sensitive). false
ENABLE_ARCH_i686 Build 32-bit toxcore. The image should have been built with SUPPORT_ARCH_i686 enabled. "true" or "false" (case sensitive). true
ENABLE_ARCH_x86_64 Build 64-bit toxcore. The image should have been built with SUPPORT_ARCH_x86_64 enabled. "true" or "false" (case sensitive). true
ENABLE_TEST Run the test suite. The image should have been built with SUPPORT_TEST enabled. "true" or "false" (case sensitive). false
EXTRA_CMAKE_FLAGS Extra arguments to pass to the CMake command when building toxcore. CMake options. -DTEST_TIMEOUT_SECONDS=90 -DUSE_IPV6=OFF

Example of running the container with options

docker run \
  -e ENABLE_TEST=true \
  -e ALLOW_TEST_FAILURE=true \
  -v /path/to/toxcore/sourcecode:/toxcore \
  -v /path/to/where/output/build/result:/prefix \
  -t \
  --rm \
  toxcore

After the build succeeds, you should see the built toxcore libraries in /path/to/where/output/build/result.

The file structure should look similar to the following

result
├── [4.0K]  i686
│   ├── [ 36K]  bin
│   │   ├── [636K]  DHT_bootstrap.exe
│   │   ├── [572K]  cracker.exe
│   │   ├── [359K]  cracker_simple.exe
│   │   ├── [378K]  create_bootstrap_keys.exe
│   │   ├── [378K]  create_minimal_savedata.exe
│   │   ├── [958K]  create_savedata.exe
│   │   ├── [ 18K]  libtoxcore.def
│   │   ├── [2.6M]  libtoxcore.dll
│   │   ├── [ 65K]  libtoxcore.exp
│   │   ├── [428K]  libtoxcore.lib
│   │   ├── [989K]  save-generator.exe
│   │   ├── [381K]  sign.exe
│   │   └── [408K]  strkey.exe
│   ├── [4.0K]  include
│   │   └── [4.0K]  tox
│   │       ├── [177K]  tox.h
│   │       ├── [ 10K]  tox_dispatch.h
│   │       ├── [ 26K]  tox_events.h
│   │       ├── [6.4K]  tox_private.h
│   │       ├── [ 26K]  toxav.h
│   │       └── [ 12K]  toxencryptsave.h
│   └── [4.0K]  lib
│       ├── [577K]  libopus.a
│       ├── [660K]  libsodium.a
│       ├── [ 10K]  libssp.a
│       ├── [1016K]  libtoxcore.a
│       ├── [456K]  libtoxcore.dll.a
│       ├── [2.7M]  libvpx.a
│       ├── [ 72K]  libwinpthread.a
│       └── [4.0K]  pkgconfig
│           ├── [ 250]  libsodium.pc
│           ├── [ 357]  opus.pc
│           ├── [ 247]  toxcore.pc
│           └── [ 309]  vpx.pc
└── [4.0K]  x86_64
    ├── [ 36K]  bin
    │   ├── [504K]  DHT_bootstrap.exe
    │   ├── [474K]  cracker.exe
    │   ├── [277K]  cracker_simple.exe
    │   ├── [287K]  create_bootstrap_keys.exe
    │   ├── [288K]  create_minimal_savedata.exe
    │   ├── [769K]  create_savedata.exe
    │   ├── [ 18K]  libtoxcore.def
    │   ├── [2.4M]  libtoxcore.dll
    │   ├── [ 64K]  libtoxcore.exp
    │   ├── [420K]  libtoxcore.lib
    │   ├── [800K]  save-generator.exe
    │   ├── [289K]  sign.exe
    │   └── [317K]  strkey.exe
    ├── [4.0K]  include
    │   └── [4.0K]  tox
    │       ├── [177K]  tox.h
    │       ├── [ 10K]  tox_dispatch.h
    │       ├── [ 26K]  tox_events.h
    │       ├── [6.4K]  tox_private.h
    │       ├── [ 26K]  toxav.h
    │       └── [ 12K]  toxencryptsave.h
    └── [4.0K]  lib
        ├── [697K]  libopus.a
        ├── [575K]  libsodium.a
        ├── [ 11K]  libssp.a
        ├── [905K]  libtoxcore.a
        ├── [449K]  libtoxcore.dll.a
        ├── [2.9M]  libvpx.a
        ├── [ 68K]  libwinpthread.a
        └── [4.0K]  pkgconfig
            ├── [ 252]  libsodium.pc
            ├── [ 359]  opus.pc
            ├── [ 249]  toxcore.pc
            └── [ 311]  vpx.pc

12 directories, 60 files
  • libtoxcore.dll is the shared library. It is fully self-contained, with no additional dependencies aside from the Windows OS dlls, and can be used in MSVC, MinGW, Clang, etc. projects. Despite its name, it provides toxcore, toxav, toxencryptsave -- all of Tox.
  • libtoxcore.a is the static library. In order to use it, it needs to be linked against the other provided .a libraries (but not the .dll.a!) and additionally -liphlpapi and -lws2_32 Windows dlls. It similarly provides all of Tox APIs.
  • libtoxcore.dll.a is the MinGW import library for libtoxcore.dll.
  • libtoxcore.lib is the MSVC import library for libtoxcore.dll.
  • libtoxcore.exp and libtoxcore.def are the exported by libtoxcore symbols.
  • *.exe are statically compiled executables -- DHT_bootstrap and the fun utils.

Pre-built binaries

Linux

Toxcore is packaged by at least by the following distributions: ALT Linux, Arch Linux, Fedora, Mageia, openSUSE, PCLinuxOS, ROSA and Slackware, according to the information from pkgs.org. Note that this list might be incomplete and some other distributions might package it too.