/ADIOS2

Next generation of ADIOS developed in the Exascale Computing Program

Primary LanguageC++Apache License 2.0Apache-2.0

License Documentation Circle CI GitHub release latest packaged version(s)

ADIOS2 : The Adaptable Input Output System version 2

This is ADIOS2: The Adaptable Input/Output (I/O) System.

ADIOS2 is developed as part of the United States Department of Energy's Exascale Computing Project. It is a framework for scientific data I/O to publish and subscribe to data when and where required.

ADIOS2 transports data as groups of self-describing variables and attributes across different media types (such as files, wide-area-networks, and remote direct memory access) using a common application programming interface for all transport modes. ADIOS2 can be used on supercomputers, cloud systems, and personal computers.

ADIOS2 focuses on:

  1. Performance I/O scalability in high performance computing (HPC) applications.
  2. Adaptability unified interfaces to allow for several modes of transport (files, memory-to-memory)
  3. Ease of Use two-level application programming interface (APIs)
  • Full APIs for HPC applications: C++11, Fortran 90, C 99, Python 2 and 3
  • Simplified High-Level APIs for data analysis: Python 2 and 3, C++11, Matlab

In addition, ADIOS2 APIs are based on:

  • MPI Although ADIOS2 is MPI-based, it can also be used in non-MPI serial code.

  • Data Groups ADIOS2 favors a deferred/prefetch/grouped variables transport mode by default to maximize data-per-request ratios. Sync mode, one variable at a time, is treated as the special case.

  • Data Steps ADIOS2 follows the actual production/consumption of data using an I/O “steps” abstraction removing the need to manage extra indexing information.

  • Data Engines ADIOS2 Engine abstraction allows for reusing the APIs for different transport modes removing the need for drastic code changes.

Documentation

Documentation is hosted at readthedocs.

Citing

If you find ADIOS2 useful, please cite our SoftwareX paper, which also gives a high-level overview to the motivation and goals of ADIOS; complementing the documentation.

Getting ADIOS2

Releases

Packages

Platform Package
Summary latest packaged version(s)
Conda Conda Version
Spack Spack package
Homebrew Homebrew package
Ubuntu 24.04 Ubuntu 24.04 package
Debian 13 Debian 13 package
Debian Unstable Debian Unstable package
OpenSUSE TumbleWeed openSUSE Tumbleweed package
OpenSUSE Leap 15.6 openSUSE Leap 15.6 package
vcpkg Vcpkg package
Dockerhub Docker Image Version

Community

ADIOS2 is an open source project: Questions, discussion, and contributions are welcome. Join us at:

Reporting Bugs

If you find a bug, please open an issue on ADIOS2 github repository

Contributing

See the Contributor's Guide to ADIOS 2 for instructions on how to contribute.

License

ADIOS2 is licensed under the Apache License v2.0. See the accompanying Copyright.txt for more details.

Directory layout

  • bindings - public application programming interface, API, language bindings (C++11, C, Fortran, Python and Matlab)

  • cmake - Project specific CMake modules

  • examples - Simple set of examples in different languages

  • scripts - Project maintenance and development scripts

  • source - Internal source code for private components

  • adios2 - source directory for the ADIOS2 library to be installed under install-dir/lib/libadios2.

  • utils - source directory for the binary utilities, to be installed under install-dir/bin

  • testing - Tests using gtest