How to configure Cluster Manager

Question

How do I set up the Cluster Manager feature to help manage my buckets?

Answer

The Cluster Manager needs at least 2 reference points to compare bucket data and user data in the Management Console.

1. Enable the Cluster Manager. Go to Settings > Cluster Manager, then enable the feature.

   Note: Only one Comet Management Console in your cluster should have Cluster Manager enabled.

2. Ensure Data Deletion is disabled until the configuration is complete and tested. When data deletion is disabled, unused buckets will not be deleted. The system logs will print info only entries, showing which buckets would be deleted if the option was enabled.
3. Set up the Comet Management Console under the target section. It can be set as "local" or "remote".

4. Set up the Comet Storage Template(s) that utilize buckets under the target section.

   Note: If the Management Console and Storage Gateway are on the same Comet Core instance, only one target is needed for both.

   Note: If you have Storage Vaults in both the main bucket and a prefix, configure two targets, one for the main bucket and one for the prefix, so Comet can list Storage Vaults inside both.

5. Add every other Management Console and Storage Gateway in your cluster as a target.

   Warning: The Cluster Manager must have access to every Management Console and Storage Gateway in your cluster. If a server or remote bucket is left out of the targets list, the Cluster Manager treats its buckets as unused and removes them. Add any new Management Console to the Cluster Manager targets as soon as you create it.
   In cometd.cfg, this is the Servers array, in the same format as replication targets and remote storage buckets.

6. Review the Bucket Users report in the About this Cluster section. 
   Once you've reviewed the report and are confident it's correct, you can enable data deletion in the Cluster Manager settings.

   The Comet Software will scan and provide a report on the bucket users, which can be viewed under the About this Cluster section of the Management Console (View last scan result or Bucket users).

   Keep an eye on the System Logs for any warnings about an install referencing a Storage Gateway outside the Cluster Manager's visibility.

   • Cluster Manager Configuration Video Tutorial | Comet Documentation

Example configurations

Comet-Hosted or direct-to-cloud

The simplest default configuration for Comet-Hosted, or Self-Hosted with all direct-to-cloud Storage Vaults, is to add the local Management Console and the cloud storage bucket. This should be the default configuration on creation of your Comet-Hosted server.

Self-Hosted with local Storage Gateway

On a single server setup, where the server hosts both the users and their data, only the local server needs to be added as a target.

Replica Storage Gateways must be added as additional targets for buckets to be deleted on both. Exclude a replica from the Cluster Manager configuration to keep deleted data on the replica.