Mackerel supports obtaining and monitoring Amazon Elasticsearch Service (ES) metrics in AWS Integration. When integrating with AWS Integration, billable targets are determined using the conversion 1 Domain = 1 Micro Host. In addition to this, depending on the number of metrics retrieved, you may be charged for exceeding the maximum number of metrics per micro host.
Please refer to the following page for AWS Integration configuration methods and a list of supported AWS services.
AWS Integration
Obtaining metrics
The metrics obtainable with AWS Integration's support for ES are as follows. For Metric explanations, refer to the AWS help page.
The maximum number of metrics obtainable is 72.
| Graph name | Metric | Metric name in Mackerel | Unit | Statistics |
|---|---|---|---|---|
| Cluster Status | ClusterStatus.green ClusterStatus.yellow ClusterStatus.red |
es.cluster_status.green es.cluster_status.yellow es.cluster_status.red |
integer | Minimum Maximum Maximum |
| Nodes | Nodes | es.nodes.count | integer | Minimum |
| Searchable Documents | SearchableDocuments | es.searchable_documents.count | integer | Average |
| Deleted Documents | DeletedDocuments | es.deleted_documents.count | integer | Average |
| CPU Utilization | CPUUtilization | es.cpu_utilization.maximum es.cpu_utilization.average |
percentage | Maximum Average |
| Free Storage Space | FreeStorageSpace | es.free_storage_space.maximum es.free_storage_space.average es.free_storage_space.minimum |
integer | Maximum Average Minimum |
| Cluster Used Space | ClusterUsedSpace | es.cluster_used_space.maximum es.cluster_used_space.minimum |
integer | Maximum Minimum |
| Cluster Index Writes Blocked | ClusterIndexWritesBlocked | es.cluster_index_writes_blocked.blocked | integer | Maximum |
| JVM Memory Pressure | JVMMemoryPressure | es.jvm_memory_pressure.maximum | percentage | Maximum |
| Automated Snapshot Failure | AutomatedSnapshotFailure | es.automated_snapshot_failure | integer | Maximum |
| Health Check | KibanaHealthyNodes MasterReachableFromNode |
es.health_check.kibana es.health_check.master |
integer | Minimum |
| KMS Key | KMSKeyError KMSKeyInaccessible |
es.kms_key.error es.kms_key.inaccessible |
integer | Maximum |
| Cluster Requests | ElasticsearchRequests InvalidHostHeaderRequests |
es.cluster_requests.count es.cluster_requests.invalid_host_header |
integer | Sum |
| Requests | 2xx 3xx 4xx 5xx |
es.requests.2xx es.requests.3xx es.requests.4xx es.requests.5xx |
integer | Sum |
| Master CPU Utilization | MasterCPUUtilization | es.master_cpu_utilization.master_cpu | percentage | Average |
| Master JVM Memory Pressure | MasterJVMMemoryPressure | es.master_jvm_memory_pressure.master_jvm | percentage | Maximum |
| EBS Disk Queue Depth | DiskQueueDepth | es.ebs_disk_queue_depth.minimum es.ebs_disk_queue_depth.average es.ebs_disk_queue_depth.maximum |
float | Minimum Average Maximum |
| EBS Latency | WriteLatency ReadLatency |
es.ebs_latency.#.minimum es.ebs_latency.#.average es.ebs_latency.#.maximum |
float | Minimum Average Maximum |
| EBS Throughput | WriteThroughput ReadThroughput |
es.ebs_throughput.#.minimum es.ebs_throughput.#.average es.ebs_throughput.#.maximum |
bytes/sec | Minimum Average Maximum |
| EBS IOPS | WriteIOPS ReadIOPS |
es.ebs_iops.#.minimum es.ebs_iops.#.average es.ebs_iops.#.maximum |
iops | Minimum Average Maximum |
| Instance Latency | IndexingLatency SearchLatency |
es.instance_latency.indexing es.instance_latency.search |
float | Average |
| Instance Rate | IndexingRate SearchRate |
es.instance_rate.indexing es.instance_rate.search |
float | Average |
| Instance Sys Memory Utilization | SysMemoryUtilization | es.instance_sys_memory_utilization.minimum es.instance_sys_memory_utilization.average es.instance_sys_memory_utilization.maximum |
percentage | Minimum Average Maximum |
| JVM GC Collection Count | JVMGCYoungCollectionCount JVMGCOldCollectionCount |
es.jvm_gc_collection_count.young es.jvm_gc_collection_count.old |
integer | Maximum |
| JVM GC Collection Time | JVMGCYoungCollectionTime JVMGCOldCollectionTime |
es.jvm_gc_collection_time.young es.jvm_gc_collection_time.old |
integer | Maximum |
| Threadpool Index Threads | ThreadpoolIndexQueue ThreadpoolIndexRejected ThreadpoolIndexThreads |
es.threadpool_index_threads.queue es.threadpool_index_threads.rejected es.threadpool_index_threads.threads |
integer | Maximum |
| Threadpool Search Threads | ThreadpoolSearchQueue ThreadpoolSearchRejected ThreadpoolSearchThreads |
es.threadpool_search_threads.queue es.threadpool_search_threads.rejected es.threadpool_search_threads.threads |
integer | Maximum |
| Threadpool Force_merge Threads | ThreadpoolForce_mergeQueue ThreadpoolForce_mergeRejected ThreadpoolForce_mergeThreads |
es.threadpool_force_merge_threads.queue es.threadpool_force_merge_threads.rejected es.threadpool_force_merge_threads.threads |
integer | Maximum |
| Threadpool Bulk Threads | ThreadpoolBulkQueue ThreadpoolBulkRejected ThreadpoolBulkThreads |
es.threadpool_bulk_threads.queue es.threadpool_bulk_threads.rejected es.threadpool_bulk_threads.threads |
integer | Maximum |
- Enter either "Write" or "Read" for the # in "Metric name in Mackerel".
Notes
Among the graphs/metrics obtainable with AWS integration, the retrieval interval differs for the metrics below.
- 5 min. interval
- Cluster Index Writes Blocked
- Request
- EBS Latency
- EBS Throughput
- EBS IOPS
- 1 hour interval
- KMS Key
- Every occurrence
- Cluster Requests