Configuring Cluster Coordination¶
Multiple ESB SI nodes can be configured to work together by configuring a cluster coordination strategy that is used in various deployments such as the Minimum High Available(HA) Deployment and Scalable High Available(HA) Deployment . At present, cluster coordination is supported via an RDBMS instance using and RDBMS coordination strategy. Support for cluster coordination via a Zookeeper instance will be supported in the near future.
At any given time, there is a leader in an SI cluster that is arbitrarily selected among the members of the cluster. The RDBMS coordination strategy that is used for cluster coordination works on the concept of heartbeats where the members of the cluster periodically send heartbeat signals via the datasource to the leader of the cluster. If the leader node does not detect a preconfigured consecutive number of heartbeats from a specific node, the relevant node is removed from the cluster. Similarly, if the leader node fails to update its heartbeat, the cluster re-elects a new leader.
Prerequisites¶
In order to configure a cluster, the following prerequisites must be completed:
- A minimum of two binary packs of ESB SI must be available.
- A working RDBMS instance must be available to be shared among the nodes of the cluster.
Configuring the Cluster with the RDBMS coordination strategy¶
To configure a cluster for several nodes, the cluster.config section of
the <SI_HOME>/conf/server/deployment.yaml
should be configured for all the nodes as follows:
Parameter | Purpose | Sample Values |
---|---|---|
enabled |
Set this value to true to enable cluster coordination for the node. |
true/false |
groupId |
The group ID is used to identify the cluster to which the node belongs. Nodes that belong to the same cluster must be configured with the same group ID. | group-1 |
coordinationStrategyClass |
The clustering class to be used. | org.wso2.carbon.cluster.coordinator.rdbms.RDBMSCoordinationStrategy |
strategyConfig > datasource |
The shared datasource to be used in the cluster. The datasource specified must be properly configured in the deployment.yaml file. For detailed instructions to configure a datasource, see Configuring Datasources . |
WSO2_CARBON_DB |
strategyConfig > heartbeatInterval |
This value defines the time interval in milliseconds between heartbeat pulses sent by nodes to indicate that they are still alive within the cluster. | 1000 |
strategyConfig > heartbeatMaxRetry |
The number of times the heartbeat pulse can be unavailable until a node is identified as unresponsive. If a node fails to send its heartbeat pulse to the leader of the cluster after a number of retries equal to the number specified here, that node is removed from the cluster. | 2 |
strategyConfig > eventPollingInterval |
The time interval in milliseconds at which a node listens to identify the changes happening within the cluster. The changes may include a new node joining the cluster, a node being removed from the cluster and the coordinator changed event. | 1000 |
Following is a sample segment of the configurations needed for RDBMS coordination in the deployment.yaml
Sample deployment.yaml segment
cluster.config:
enabled: true
groupId: <GROUP ID>
coordinationStrategyClass: org.wso2.carbon.cluster.coordinator.rdbms.RDBMSCoordinationStrategy
strategyConfig:
datasource: <DATASOURCE NAME>
heartbeatInterval: 5000
heartbeatMaxRetry: 5
eventPollingInterval: 5000
Top