Skip navigation links

Package io.aeron.cluster

Note: Aeron Cluster is currently a preview feature, commercial support and training is available from [email protected].

See: Description

Package io.aeron.cluster Description

Note: Aeron Cluster is currently a preview feature, commercial support and training is available from [email protected].

The purpose of Aeron Cluster is to aggregate and sequence streams from cluster clients into a single log. This log is replicated and archived on a number of nodes to achieve fault tolerance. Cluster services process this log and respond to cluster clients.

Aeron Cluster works on the concept of a strong leader using an adaptation of the Raft protocol. The leader sequences the log and is responsible for replicating it to other cluster members known as followers.

Aeron Cluster is composed of a number of components. Central is the Consensus Module which sequences the log and coordinates consensus on the recording of the sequenced log to persistent storage, and the services consuming the log across cluster members. Recording of the log to persistent storage is performed by the Aeron Archive module. Services consume the log once a majority of the cluster members have safely recorded the log to persistent storage.

To enable fast recovery, the services and consensus module can take a snapshot of their state as of a given log position thus enabling recovery by loading the most recent snapshot and replaying logs from that point forward. Snapshots are recorded as streams in the Archive for local and remote replay so that a distributed file system is not required.

Usage

The cluster can run in various configurations:

Based on the membership size, consensus is determined by the majority of the cluster members. Clusters should be 3 or 5 in population size. However, 2 node clusters are supported whereby both members must agree the log and in the event of failure the remaining member must be manually reconfigured as a single node cluster.

Protocol

Messages are specified using SBE in aeron-cluster-codecs.xml
Skip navigation links

Copyright © 2014-2021 Real Logic Limited. All Rights Reserved.