Vertica – Recovery Monitoring

Use the admintools view_cluster tool from the command line to see the cluster state:

$ /opt/vertica/bin/admintools -t view_cluster»

DB | Host | State

———+————–+————

<data_base> | 112.17.31.10 | RECOVERING

<data_base> | 112.17.31.11 | UP

<data_base> | 112.17.31.12 | UP

<data_base> | 112.17.31.17 | UP

________________________________

2 Main tables for monitoring recovery within the database –

RECOVERY_STATUS

PROJECTION_RECOVERIES

However the database has to be UP to be able to use! so only really useful when only one node is recovering and cluster is k-safety compliant.

Specifically, the recovery_status system table includes information about the node that is recovering, the epoch being recovered, the current recovery phase, and running status:

select node_name, recover_epoch, recovery_phase, current_completed, is_running 
from recovery_status;

The projection_recoveries system table maintains history of projection recoveries. To check the recovery status, you can summarize the data for the recovering node, and run the same query several times to see if the counts change. Differing counts indicate that the recovery is working and in the process of recovering all missing data.

select node_name, status , progress from projection_recoveries; 

After recovery is complete, all nodes should show UP.

Checking the epoch should show all the nodes at the same level.

EPOCH

A logical unit of time in which a single change is made to data in the system.

SELECT GET_CURRENT_EPOCH();
Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: