Help Amazon Web Services AWS Storage Gateway

AWS Storage Gateway Monitoring Integration

AWS Storage Gateway service seamlessly provides a secure integration between an organization's on-premises applications and the AWS cloud. AWS Storage Gateway comes in three different types, as a File Gateway, Volume Gateway, and a Tape Gateway, each designed to suit specific needs and requirements.

With Site24x7's integration, you can now easily monitor the storage gateway service at File Gateway, Volume Gateway, and a Tape Gateway level.

Setup and configuration

1. If you haven't already, enable access to your AWS resources between your AWS account and Site24x7's AWS account by either:

  • Creating Site24x7 as an IAM user.
  • Creating a cross-account IAM role. Learn more

2. On the Integrate AWS Account page, check the appropriate box for AWS Storage Gateway to monitor. We offer you with 3 different monitors; Storage Gateway, Storage Gateway File Share, and Storage Gateway Volume to choose from. Learn more

Policy and permissions

Site24x7 uses various AWS Storage Gateway APIs to collect information about your storage gateway. Assign the AWS managed policy ReadOnlyAccess to the Site24x7 entity (IAM user or IAM role) to help Site24x7 collect metrics and metadata. If you want to assign a custom policy, please make sure the following read-level actions are present in the policy JSON. Learn more

  • "storagegateway:DescribeGatewayInformation",
  • "storagegateway:ListGateways",
  • "storagegateway:ListTagsForResource",
  • "storagegateway:ListTapes",
  • "storagegateway:ListFileShares",
  • "storagegateway:ListVolumes",
  • "storagegateway:DescribeAvailabilityMonitorTest",
  • "storagegateway:DescribeBandwidthRateLimit",
  • "storagegateway:DescribeCache",
  • "storagegateway:DescribeCachediSCSIVolumes",
  • "storagegateway:DescribeNFSFileShares",
  • "storagegateway:DescribeSMBFileShares",
  • "storagegateway:DescribeStorediSCSIVolumes",
  • "storagegateway:DescribeTapeArchives",
  • "storagegateway:DescribeTapes",
  • "storagegateway:DescribeUploadBuffer",
  • "storagegateway:ListLocalDisks",
  • "storagegateway:DescribeVTLDevices",
  • "logs:DescribeLogStreams",
  • "logs:GetLogEvents"

 

Polling Frequency

Site24x7 queries AWS to collect Storage Gateway performance metrics according to the configured poll frequency. The minimum poll interval supported is one minute and the maximum is 24 hours. Learn more

Storage Gateway Performace Metrics

AttributeDescriptionStatisticData Type
Cache Hit Percent Percent of application reads served from the cache. The sample is taken at the end of the reporting period. Average Percentage
Upload Buffer Percent Used Percent use of the gateway's upload buffer. The sample is taken at the end of the reporting period. Average Percentage
Upload Buffer Used The total number of bytes being used in the gateway's upload buffer. The sample is taken at the end of the reporting period. Average MB
Cache Used The total number of bytes being used in the gateway's cache storage. The sample is taken at the end of the reporting period. Average MB
Queued Writes The number of bytes waiting to be written to AWS, sampled at the end of the reporting period for all volumes in the gateway. These bytes are kept in your gateway's working storage. Sum MB
Read Bytes The total number of bytes read from your on-premises applications. Sum,Sample count MB
Read Time The total number of milliseconds spent to do read operations from your on-premises applications. Average Milliseconds
Total Cache Size The total size of the cache in bytes. The sample is taken at the end of the reporting period. Average MB
Write Bytes The total number of bytes written to your on-premises applications. Sum,Sample count MB
Write Time The total number of milliseconds spent to do write operations from your on-premises applications. Sum Milliseconds
Time Since Last Recovery Point The time since the last available recovery point. Sum Seconds
Working Storage Free The total amount of unused space in the gateway's working storage. The sample is taken at the end of the reporting period. Sum MB
Working Storage Percent Used Percent use of the gateway's upload buffer. The sample is taken at the end of the reporting period. Sum Percent
Working Storage Used The total number of bytes being used in the gateway's upload buffer. The sample is taken at the end of the reporting period. Sum MB
Index Evictions The number of files whose metadata was evicted from the cached index of file metadata to make room for new entries. The gateway maintains this metadata index, which is populated from the AWS Cloud on demand. Sum,Sample count, Average Number
Index Fetches The number of files for which metadata was fetched. The gateway maintains a cached index of file metadata, which is populated from the AWS Cloud on demand. Sum,Sample count, Average Number
Cloud Bytes Downloaded The total number of bytes that the gateway downloaded from AWS during the reporting period. Sum MB
Cloud Bytes Uploaded The total number of bytes that the gateway uploaded to AWS during the reporting period. Sum MB
Cloud Download Latency The latency while downloading bytes from the cloud. Maximum Milliseconds
Cache Percent Dirty The volume's contribution to the overall percentage of the gateway's cache that isn't persisted to AWS. The sample is taken at the end of the reporting period. Average Percent
Cache Free The amount of cache that is not used. Average MB
Upload Buffer Free The amount of upload buffer that is not used. Average MB
User CPU Percent Percent of CPU time spent on gateway processing, averaged across all cores. Average Percent
IO Wait Percent Percent of time that the gateway is waiting on a response from the local disk. Average Percent
Mem Total Bytes Amount of RAM provisioned to the gateway VM, in bytes. Average MB
Mem Used Bytes Amount of RAM currently in use by the gateway VM, in bytes. Average MB
Availabilty Notifications Number of availability-related health notifications generated by the gateway. Sum Number
Health Notifications The number of health notifications. Sum Number
SmbV1 Sessions The number of Server Message Block (SMB) version 1 sessions that are active on the gateway. Sum Number
SmbV2 Sessions The number of Server Message Block (SMB) version 2 sessions that are active on the gateway. Sum Number
SmbV3 Sessions The number of Server Message Block (SMB) version 3 sessions that are active on the gateway. Sum Number

Storage Gateway File Share Metrics

AttributeDescriptionStatisticData Type
Cache Hit Percent Percent of application read operations from the file shares that are served from cache. The sample is taken at the end of the reporting period. Sum Percent
Read Bytes The total number of bytes read from your on-premises applications in the reporting period for a file share. Sum,Sample Count MB
Write Bytes The total number of bytes written to your on-premises applications in the reporting period. Average Percentage
Cloud Bytes Uploaded The total number of bytes that the gateway uploaded to AWS during the reporting period. Sum MB
Cloud Bytes Downloaded The total number of bytes that the gateway downloaded from AWS during the reporting period. Sum Bytes
Index Fetches The number of files for which metadata was fetched. The gateway maintains a cached index of file metadata, which is populated from the AWS Cloud on demand. Sum Number
Cache Percent Used The file share's contribution to the overall percent use of the gateway's cache storage. The sample is taken at the end of the reporting period. Average Percent
Cache Percent Dirty The file share's contribution to the overall percentage of the gateway's cache that has not been persisted to AWS. The sample is taken at the end of the reporting period. Sum Percent

Storage Gateway Volume Metrics

AttributeDescriptionStatisticData Type
Cache Hit Percent Percent of application read operations from the volume that are served from cache. The sample is taken at the end of the reporting period. Average Percent
Cache Percent Dirty The volume's contribution to the overall percentage of the gateway's cache that isn't persisted to AWS. The sample is taken at the end of the reporting period. Average Percent
Cache Percent Used The volume's contribution to the overall percent use of the gateway's cache storage. The sample is taken at the end of the reporting period. Average Percent
Client Traffic The number of bytes that the tape sent and received from on-premises clients. That is, the total amount of ReadBytes and WriteBytes from client applications. Sum MB
Cloud Traffic The number of bytes uploaded and downloaded from the cloud to the volume. Sum MB
CPU Usage The percentage of allocated CPU compute units that are currently used by the volume. Average Percent
Health Notification Count The number of health notifications sent by the volume. Sum Count
Memory Usage The percentage of allocated memory that is currently used by the volume. Average Percent
Read Bytes The total number of bytes read from your on-premises applications in the reporting period. Sum,Sample count MB
Read Time The total number of milliseconds spent on read operations from your on-premises applications in the reporting period. Average Milliseconds
Write Bytes The total number of milliseconds spent on read operations from your on-premises applications in the reporting period. Sum,Sample count MB
Write Time The total number of milliseconds spent on write operations from your on-premises applications in the reporting period. Average Milliseconds
Queued Writes The number of bytes waiting to be written to AWS, sampled at the end of the reporting period. Sum MB

Forecast

Estimate future values of the following performance metrics and make informed decisions about adding capacity or scaling your AWS infrastructure.

  • Cache Hit Percent
  • Upload Buffer Percent Used
  • Working Storage Percent Used
  • User CPU Percent
  • IO Wait Percent
  • Cache Percent Dirty
  • Cache Percent Used

Site24x7's Storage Gateway monitoring interface

Summary

Gain an overview of different events occurring within each resource with time series charts. This section provides you with operational details on read bytes per second, write bytes per second, cloud download bytes per second, cloud upload bytes per second, and many more metrics.

Configuration

The configuration details of a storage gateway are provided under this tab. Details on the storage gateway, like the name, ID, time zone, and type of gateway are provided in this section.

Monitored Resources

On the Monitored Resources tab, you can view a list of file shares, volumes, and names of the resources associated with your storage gateway environment. Click on an individual listing to see performance and resource usage stats associated with that resource. You can also set thresholds and be notified when any of these services fail by clicking the pencil icon under Action.

Tapes

The tapes section will be available only for Tape Gateway. In this section you get a consolidated view of the tape barcode, type of tape, its size, status and created date.

VTL Device

The VTL Device tab will be available only for Tape Gateway. Here, a list of Tape device ID, VTL Device name, VTL device type, target name, and port will be displayed.

Recent Logs

Here, you can view the audit log data of a storage gateway along with the timestamp, published by CloudWatch logs.

Was this document helpful?
Thanks for taking the time to share your feedback. We’ll use your feedback to improve our online help resources.

Help Amazon Web Services AWS Storage Gateway