No description
Find a file
2024-10-28 19:13:47 +01:00
.gitlab/merge_request_templates Add merge request template and contribution guidelines 2024-06-03 13:10:58 +02:00
components bundle7: Limit allowed values for bundle block type and fix assertion 2024-10-22 09:44:55 +02:00
doc Bump date in Manpage 2024-10-28 09:47:10 +01:00
dockerfiles cla_sqlite: Add SQLite-based storage CLA skeleton 2024-06-03 13:41:58 +02:00
external external/checkpatch: Import new version from linux v6.10 2024-09-11 10:10:43 +02:00
generated Refactor FIB: Separate node entry from CLA link 2024-08-23 11:59:02 +02:00
include bundle7: Limit allowed values for bundle block type and fix assertion 2024-10-22 09:44:55 +02:00
mk Re-integrate v0.13.0 routing code as "integrated default BDM" 2024-07-15 00:46:14 +02:00
nix Bump version to v0.14.1 2024-10-28 09:47:24 +01:00
pyd3tn Bump version to v0.14.1 2024-10-28 09:47:24 +01:00
python-ud3tn-utils Bump version to v0.14.1 2024-10-28 09:47:24 +01:00
test test/run_hdtn_test: Increase timeout and prevent unbound var 2024-10-22 11:39:34 +02:00
tools tools, mk: clang-{check,tidy}: Simplify invocation, add missing dirs 2024-09-11 10:10:43 +02:00
.dockerignore Reuse working directory files in uD3TN Dockerfile and add dockerignore 2021-01-12 14:35:29 +01:00
.gitignore nix: Test multiple μD3TN services on one host 2024-07-01 11:04:04 +02:00
.gitlab-ci.yml CI: Enable sanitizers for data decoder test 2024-10-22 11:20:12 +02:00
.gitmodules Add AAP 2.0 component stub with Protobuf support via Nanopb 2023-11-08 15:11:52 +01:00
CHANGELOG Update CHANGELOG for v0.14.1 2024-10-28 09:46:55 +01:00
config.mk.example cmdline: Documentation fixes related to AAP v1 arguments 2024-10-02 07:49:46 +02:00
CONTRIBUTING.md Add merge request template and contribution guidelines 2024-06-03 13:10:58 +02:00
DCO.txt Add CONTRIBUTING.md and DCO.txt 2020-11-14 12:01:02 +01:00
flake.lock flake.lock: Update 2024-07-17 11:17:39 +02:00
flake.nix nix: Add SPDX-License-Identifier 2024-07-01 11:04:04 +02:00
LICENSE Update whole-package license to AGPLv3 and add contribution info 2024-06-03 13:10:58 +02:00
LICENSE.Apache-2.0 Update license to BSD-3-Clause OR Apache-2.0 2022-02-19 23:33:37 +01:00
Makefile tools, mk: clang-{check,tidy}: Simplify invocation, add missing dirs 2024-09-11 10:10:43 +02:00
NOTICE Update NOTICE to new licensing scheme 2024-06-03 13:11:28 +02:00
README.md cmdline, docs: Warn about potentially insecure AAP TCP arguments 2024-10-02 07:49:46 +02:00

About

µD3TN (pronounced "Micro-Dee-Tee-En") is a free, lean, and space-tested DTN protocol implementation running on POSIX (plus Linux ;-)). Though µD3TN is easily portable to further platforms, we currently only support POSIX-compliant systems (former versions also included support for STM32/FreeRTOS platforms).

For quickly getting up to speed, check out our Quick Start Guide!

What does µD3TN provide?

A general introduction of µD3TN is available on its project web site at https://d3tn.com/ud3tn.html and in our video series on YouTube.

µD3TN currently implements:

Pre-compiled binaries

We provide docker images at registry.gitlab.com/d3tn/ud3tn-docker-images/ud3tn. Refer to https://gitlab.com/d3tn/ud3tn-docker-images/ for more information.

Usage

A comprehensive step-by-step tutorial for Linux and POSIX systems is included in the documentation. It covers a complete scenario in which two µD3TN instances create a small two-node DTN and external applications leverage the latter to exchange data.

Start a µD3TN node

For simple setups with just a single node, µD3TN is ready to use with its default settings. For advanced use, the CLI offers at lot of flexibility:

Mandatory arguments to long options are mandatory for short options, too.

  -a, --aap-host HOST         IP / hostname of the application agent service (may be insecure!)
  -A, --aap2-host HOST        IP / hostname of the AAP 2.0 service (may be insecure!)
  -b, --bp-version 6|7        bundle protocol version of bundles created via AAP
  -c, --cla CLA_OPTIONS       configure the CLA subsystem according to the
                              syntax documented in the man page
  -d, --external-dispatch     do not load the internal minimal router, allow for using an AAP 2.0 BDM
  -e, --node-id NODE_ID       local node identifier (referring to the administrative endpoint)
  -h, --help                  print this text and exit
  -l, --lifetime SECONDS      lifetime of bundles created via AAP
  -L, --log-level             higher or lower log level [1, 2, 3, 4] specifies more or less detailed output
  -m, --max-bundle-size BYTES bundle fragmentation threshold
  -p, --aap-port PORT         port number of the application agent service (may be insecure!)
  -P, --aap2-port PORT        port number of the AAP 2.0 service (may be insecure!)
  -r, --status-reports        enable status reporting
  -R, --allow-remote-config   allow configuration via bundles received from CLAs (insecure!)
  -s, --aap-socket PATH       path to the UNIX domain socket of the application agent service
  -S, --aap2-socket PATH      path to the UNIX domain socket of the experimental AAP 2.0 service
  -u, --usage                 print usage summary and exit
  -x, --bdm-secret-var VAR    restrict AAP 2.0 BDM functions to clients providing the secret in the
                              given environment variable

Default invocation: ud3tn \
  -b 7 \
  -c "sqlite:file::memory:?cache=shared;tcpclv3:*,4556;smtcp:*,4222,false;mtcp:*,4224" \
  -e dtn://ud3tn.dtn/ \
  -l 86400 \
  -L 3 \
  -m 0 \
  -s $PWD/ud3tn.socket
  -S $PWD/ud3tn.aap2.socket

The AAP interface can use either a UNIX domain socket (-s option) or bind to a TCP address (-a and -p options). Examples for CLA_OPTIONS are documented in the man page, which can be viewed with man --local-file doc/ud3tn.1. Default arguments and internal settings such as storage, routing, and connection parameters can be adjusted by providing a customised config.mk file.

Configure contacts with other µD3TN / BP nodes

µD3TN performs its bundle forwarding decisions based on contacts, which are associated with a specific bundle node. Each instance accepts bundles addressed to dtn://<ud3tn-node-name>/config or ipn:<ud3tn-node-number>.9000 (by default, only via AAP or AAP 2.0) and parses them according to the specification documented at doc/contacts_data_format.md. To sum it up, the interface can be used to configure:

  • which next-hop bundle nodes are available,
  • the CLA address through which each next-hop node can be contacted,
  • start and end time of contacts with the node (optional),
  • data rate during each contact (optional), and
  • which other nodes the bundle node can reach in general and during a specific contact (list of EIDs, optional).

This repository includes convenient python tools that can be used after preparing the python environment to configure contacts. See also the Quick Start Guide for some hands-on examples.

Leverage AAP to make applications delay and disruption tolerant

Once a µD3TN enabled DTN network has been created, applications can leverage the Application Agent Protocol (AAP) to interact with it. Applications typically use AAP to:

  • register themselves at a µD3TN instance with a local identifier,
  • inject bundles (hand over a payload and a destination EID to µD3TN, µD3TN then creates a corresponding bundle and tries to forward / deliver it), and
  • listen for application data addressed to their identifier.

µD3TN implements two versions of AAP:

Develop

Build

This project uses git submodules to manage some code dependencies. Use the --recursive option if you git clone the project or run git submodule init && git submodule update at a later point in time.

POSIX-compliant operating systems

  1. Install or unpack the build toolchain

    • Install GNU make, gcc and binutils.
    • Install the sqlite development package (including sqlite3.h and libsqlite3.so).
    • For building with Clang, additionally install a recent version of clang and llvm.
  2. Configure the local build toolchain in config.mk (optional for most systems)

    • Copy config.mk.example to config.mk.
    • Adjust TOOLCHAIN if you want to build with Clang.
    • Adjust TOOLCHAIN_POSIX if your toolchain installation is not included in your $PATH
  3. Run make run-posix to build and execute µD3TN on your local machine.

    • You can find the µD3TN binary file in build/posix/ud3tn. To just build it, you can also run make posix or make (the latter building the library files as well).
    • Note that on some systems, such as BSD flavors, you may need to explicitly call GNU Make using the gmake command. In this case, just substitute all calls to make in the documentation by gmake.
    • Some build-time options (e.g., building with sanitizers) can be easily specified as arguments to make. See config.mk.example for the values you can specify. Example: make sanitize=yes

Nix-based build and development

  1. Install the nix package manager
  2. Enable flake support
    • Temporary: Add --experimental-features 'nix-command flakes' when using any nix commands
    • Permanent: Add experimental-features = nix-command flakes to ~/.config/nix/nix.conf or /etc/nix/nix.conf

Most common nix commands are:

  • Build & run ud3tn:

    nix run '.?submodules=1'
    
  • Build individual packages:

    nix build '.?submodules=1#ud3tn'
    nix build '.?submodules=1#pyd3tn'
    nix build '.?submodules=1#python-ud3tn-utils'
    
  • Load a development environment with all packages and dependencies:

    nix develop '.?submodules=1'
    

    After the development environment has been activated, all development dependencies are fulfilled in order to be able to execute all other described debug and build commands.

Library

Beside the µD3TN daemon binary, two types of library can be built using make posix-lib or make:

  • build/posix/libud3tn.so: a dynamic library (shared object) containing all but the daemon functions.
  • build/posix/libud3tn.a: a thin static library providing the same functionality. This only references the component.a files in the build directory and is intended to statically link µD3TN into other projects. The preferred way to do this is to include µD3TN as part of your project's source tree (e.g. using git subtree or git submodule).

Build the Protobuf headers

For changes to the Protobuf definitions for AAP 2.0 and the storage agent, you may want to re-generate the corresponding C headers and Python modules. This can be done via:

# For AAP 2.0
make aap2-proto-headers
# For the storage agent
make storage-agent-proto-headers

The preferred way to run these commands is from within a Nix shell, e.g., launched using the aforementioned command nix develop '.?submodules=1'. Note that the used protoc and python-protobuf versions need to be compatible, which is hard to ensure if both are managed by different package managers (protoc is typically installed using the system's package manager, while python-protobuf is installed in the virtual environment using pip). Nix takes care of this for us.

Test

The µD3TN development is accompanied by extensive testing. For this purpose, you should install gdb and a recent version of Python 3 (>= 3.8), plus the, venv and pip packages for your Python version. Our test suite covering static analysis, unit, and integration tests is documented in doc/testing.md.

Contribute

Contributions in any form (e.g., bug reports, feature, or merge requests) are very welcome! Please have a look at CONTRIBUTING.md first for a smooth experience. The project structure is organized as follows:

.
├── components             C source code
├── doc                    documentation
├── dockerfiles            Templates for creating Docker images
├── external               3rd party source code
├── generated              generated source code (e.g. for Protobuf)
├── include                C header files
├── mk                     make scripts
├── nix                    nix derivations, modules and tests
├── pyd3tn                 Python implementation of several DTN protocols
├── python-ud3tn-utils     Python bindings for AAP
├── test                   various test routines
└── tools                  various utility scripts

The entry point is implemented in components/daemon/main.c.

License

This work is licensed as a whole under the GNU Affero General Public License v3.0, with some parts and components being licensed under the BSD 3-Clause, Apache 2.0, MIT, zLib, and GPL v2.0 licenses. This licensing scheme is applied since early 2024, after the release of version v0.13.0 under the Apache 2 and BSD 3-Clause licenses.

All code files, except those under the external/ directory tree, contain an SPDX license identifier at the top, to indicate the license that applies to the specific file. The external libraries shipped with µD3TN and contained in external/ are subject to their own licenses, documented in LICENSE-3RD-PARTY.txt.

SPDX-License-Identifier: AGPL-3.0-or-later

Ecosystem

  • ud3tn-utils is a Python package that provides bindings for µD3TN's Application Agent Protocol and Application Agent Protocol v2.
  • aap.lua is a Wireshark dissector for µD3TN's Application Agent Protocol. It can be installed by copying it into one of the Lua script folders listed in the Wireshark GUI at Help > About Wireshark > Folders.
  • pyD3TN is a Python package that provides implementations of several DTN related RFCs.
  • aiodtnsim is a minimal framework for performing DTN simulations based on Python 3.7 and asyncio.
  • dtn-tvg-util is a Python package simplifying the analysis and simulation of DTNs based on time-varying network graphs.

See also

  • RFC 4838 for a general introduction about DTN networks.
  • ION: NASA's (JPL) bundle protocol implementation that has been successfully demonstrated to be interoperable with µD3TN.
  • HDTN: NASA's performance optimized implementation of the DTN standard.
  • DTN7-rs: Rust implementation of a disruption-tolerant networking (DTN) daemon for the Bundle Protocol version 7 - RFC9171.