1. Knowledge Base
  2. CloudFS Maintenance

High Availability Operations

This article describes the available operations for Panzura High Availability, and how to use them.

To manage High Availability (HA) settings, navigate to the following section in Panzura’s WebUI:

Maintenance > Master Filer Operations

Viewing HA Status

To view HA status, log in to the WebUI and navigate to the Cloud File System Dashboard. HA status is shown in the HA Filer Status dashlet (located by default under the Active Filer Status dashlet).

The HA Filer Status dashlet shows the following information:

Column Description
File System

Name of the file system protected by HA.

To find the filer associated with the file system, see the File System and Filer Hostname columns in the Active Filer Status dashlet.

Note: For Global HA, the file system name is “All”.

Primary / Secondary

File system names that are being protected.

  • Local HA: Names of the file systems on the filers in the active-standby air. The primary filer is the one that initially is the active filer. The asterisk ( * ) indicates that the filer that is currently active.
  • Global HA: Name of the filer that is configured as the standby for Global HA.
State

The HA state of the file system:

  • Ready: Failover is possible.
  • Not Ready: Failover is not possible because at least one of the filers is currently not meeting criteria for failover. For example, in an Auto Failover configuration, if the active filer’s number of dirty snapshots is too high, an automated failover is not allowed.
  • Down: The file system is down.
Auto Failover State of the Auto Failover feature.

 

Auto Failover Details

To display Auto Failover details for an active-standby pair of filers, click on a row in the Primary / Secondary column of the HA Filer Status dashlet. The Auto Failover Status dialog appears:

In this example, Auto Failover details for active-standby pair cc8 / cc7. The active filer in the pair is cc8.

High Availability Takeover

To perform a takeover, the active filer must have failed or powered down. The HA standby can be activated only if the original active controller is no longer online. There is a delay between the time that the active filer becomes unavailable and when the takeover is possible.

Takeover for HA-Global or HA-Local (no Shared Address)

Follow this procedure for HA-Global or HA-Local without shared address. See Takeover for HA-Local with shared address for takeover with shared address.

  1. Verify that the Filer that is the target of the takeover is down.
  2. Log in to the standby filer if you are not already logged in, and verify that it is the standby. Click in the upper right corner of the WebUI and verify that the Configuration Mode is Standby. If you have configured HA-Local and there are multiple HA Local pairs in the CloudFS, verify that you are on the correct one.
  3. If this is a planned takeover, check the sync status by opening the Dashboard page and looking at the Active Filer Status and Spare Filer Status sections. If it is not a planned takeover, the process will take longer if the Filers are not synchronized.
  4. Select Maintenance > High Availability.
  5. Click CONFIRMto continue.

The Takeover process log appears and provides process information.

  • Do not close the process log window.
  • Do not change any DNS settings until the Takeover Complete message is displayed. Doing so could cause the filer to become confused over which filer is the source.

 

  1. On the DNS server, locate the active records for the previous active filer and the standby filer.
  2. Switch the IP addresses so the standby filer is now the active filer.
  3. On the new active filer go to Configuration > Active Directory.
  4. Rejoin the filer to the Active Directory.
  5. Verify that the DNS is pointing to the correct filer, that the IP addresses were properly switched.
  6. When the previously active filer becomes available, you can bring it up as the new stand-by filer.

The process is now complete. The new active filer should be up and running.

Takeover for HA-Local with Shared Address

As described in Important Information About HA-Local with Shared Address, the shared IP address/hostname that you configured when setting up the HA-Local standby is the one that is used to access the active Filer during normal operations. You will use the same address/hostname to access the standby Filer when it comes up as the new active filer.

  1. Verify that the active filer is down.
  2. Log in to the standby filer, and verify that it is the standby. Click in the upper right corner of the WebUI and verify that the Configuration Mode is Standby. If there are multiple HA-Local pairs in the CloudFS, verify that you are on the correct one.
  3. If this is a planned takeover, check the sync status by opening the Dashboard page and looking at the Active Filer Status and Spare Filer Status sections. If it is not a planned takeover, the process will take longer if the filers are not synchronized.
  4. Select Maintenance > High Availability.
  5. Click CONFIRM to continue.

The Takeover process log appears and provides process information. 

Do not close the process log window.

  1. On the new active filer go to Configuration > Active Directory.
  2. Rejoin the filer to Active Directory and proceed with normal operations.
  3. When the previously active filer becomes available, you can bring it up as the new stand-by filer.

The process is now complete. The new active filer should be up and running.

Failback (HA-Local only)

Failback applies only to HA Local (with or without shared address). For HA Global, there is no failback process. Following an HA Global takeover, you must reinitialize and reconfigure the failed filer to add it again as either an active or standby filer.

  1. Verify that snapshots are in sync by checking the Dashboard page on the current active filer (the former standby filer), and that there is no dirty cache.
  2. Shut down the current active filer.
  3. Bring the current standby filer (the original active filer) up and sign in.
  4. Follow the steps in Takeover to switch back to the original active filer.