Mackerel blog #mackerelio

The Official Blog of Mackerel

AWS Integration now supports CloudFront

Hello! Mackerel team CRE Miura (id:missasan) here.

Following the recent release of DynamoDB, a new feature has been added for AWS Integration!

AWS Integration now supports CloudFront

Refer to the help page below for more on obtainable metrics.

mackerel.io

This feature is the second of which was co-developed with iret Inc., following the recent release of our DynamoDB integrated feature!

Billable targets are determined using the conversion 1 Distribution = 1 Host. Additionally, since CloudFront is a global service, integration with CloudFront is possible regardless of the region selected in the AWS integration settings.

If you use CloudFront, be sure to enable this feature and give it a try. We welcome your feedback!

Check monitoring plugin for AWS CloudWatch Logs added etc.

Hello! Mackerel team CRE Miura (id:missasan) here.

Mackerel will be attending Cloud Impact 2018 which is scheduled to run from October 17th (Wednesday) through October 19th (Friday) at Tokyo Big Sight. Be sure to stop by the Mackerel booth!

Now on to this week’s update information.

Check monitoring plugin for AWS CloudWatch Logs added

The mackerel-check-plugins package has been updated to v0.23.0. With this update, we’ve added check-aws-cloudwatch-logs, a check plugin for AWS CloudWatch Logs! For more details such as on how to use, check out the help page below.

mackerel.io

Listed below are some additional notes about the plugin.

If you have any points of concern, be sure to submit an issue / pull request to the official Github repository or contact our support team!

BurstBalance metrics have been added for AWS・RDS Integration

General purpose SSD (gp2) volume Burst Balance metrics can now be obtained in AWS · RDS integration. Be sure to give it a try.

Mackerel at Cloud Impact 2018! October 17-19 (Wed. - Fri.)

Details are as follows. We are looking forward to seeing everyone at our booth!

  • Date: October 17 (Wednesday) to October 19 (Friday)
  • Place: Tokyo Big Sight East Hall 1-3
  • Admission fee: 3,000yen (tax included, free for those invited/pre-registered)

AWS Integration now supports DynamoDB etc.

Hello! Mackerel team CRE Miura (id:missasan) here.

This week, a new feature has been added for AWS integration. The long-awaited DynamoDB is now supported.

Now on to the latest update information.

AWS Integration now supports DynamoDB

Refer to the help page below for more on obtainable metrics.

mackerel.io

This feature was co-developed together with iret Inc., a development firm with abundant AWS operational knowledge. iret Inc. offers the cloudpack service, which provides fully managed services for a variety of AWS products. iret, thank you for all your help!

Webhook can now be registered with notification channel APIs

In addition to email and Slack notifications, it is now possible to register Webhook notification channels using the API. For more details, check out the notification channel API document below.

mackerel.io

API key clipboard added to the GUI installation procedure for Windows servers when registering a new host

In the “Register a new Host” screen that can be accessed from the left sidebar menu, an API key clipboard was added to the GUI installation procedure for Windows servers.

You can copy the API key from the same screen as seen below.

If you have any ideas or points of improvement regarding how to install mackerel-agent on Windows servers, we would gladly welcome your feedback.

Regarding the incident that occurred on September 26, 2018 (Wed.)

Thank you for choosing Mackerel.

This is an announcement to report on the incident that occurred today (9/26).

Today at 10:51 am (JST), the API server error rate increased and became unstable.

In terms of this phenomenon, access to the API server failed, and a 5xx status code was most likely returned resulting in an error.

As the API server error rate increased, connectivity monitoring was suspended in order to prevent false reports.

After that, the unstable conditions continued for an extended period of time. At 4:20 pm (JST), recovery measures were taken by adjusting application parameters and reinforcing the server.

We were not able to identify the direct cause and will continue to further investigate this issue. Additionally, starting tomorrow, operations will be implemented to prevent secondary issues from occurring. Please note that depending on the operation, we may temporarily switch to maintenance mode (restricted access to the server).

We apologize for any inconvenience this issue may have caused.

Thank you for your cooperation.

loadavg1 and loadavg15 added to system metrics etc.

Hello! Mackerel team CRE Miura (id:missasan) here.

ISUCON8 was held last weekend and Mackerel team members Matsuki (id:Songmu) and Shibasaki(id:id:shiba_yu36) both made it through the qualifying round. I’m looking forward to the main event.

Now on to the latest update information.

loadavg1 and loadavg15 added to system metrics

With the release of mackerel-agent v0.57.0, loadavg1 and loadavg15 have been added to the loadavg graph which previously only supported loadavg5. Now you can conveniently compare loadavg5 and loadavg15 to check whether the CPU load is increasing or decreasing. When updating mackerel-agent to the latest version, two system metric items will be added to the target host.

This update is compatible with all platforms except Windows Server.

The log rotation tracking accuracy for check-log plugin has been improved

With the release of go-check-plugins v0.22.1, a change was made to the inode number for when tracking log files with the check-log plugin. With this, the tracking accuracy for log files when logs are rotated has improved.

You can now specify the number of redirects with check-http

With the release of go-check-plugins v0.22.1, you can now specify the number of follow up redirects with the option --max-redirects (the default is 10).

Thank you for your contributions!

Null values changed to 0 for AWS ALB/ELB RequestCount metrics

In environments where ALB / ELB metrics are obtained with the AWS Integration feature, a change was made to now post 0 if the RequestCount metric value obtained from CloudWatch is null. This fixes the problem of alerts not closing automatically, which was previously caused by the null value.

Code signing certificate for Windows Server installer updated

With the release of mackerel-agent v 0.57.0, the code signing certificate for Windows Server installer has been updated. Please note that if you use the previous version of the installer, a certificate expiration warning will occur.

【Summer student intern feature release!】An Organizations list screen has been added etc.

Hello! Mackerel team CRE Miura (id:missasan) here.

Today is the last day of the 2018 Hatena Summer Internship program. This month went by so fast!

developer.hatenastaff.com (Japanese only)

For the second half of the program, the student interns are assigned to each team and work on task assignments and feature developments that will actually be incorporated into the service. Two student interns were also assigned to the Mackerel team and were challenged with a lot of issues.

The feature that was introduced last Monday (9/3) titled "Roles can now be registered/deleted from the API" was implemented and released by our two student interns.

mackerel.io

Since it’s the last day of the summer internship, we are going to introduce a complete set of the features implemented by our student interns.

Here is a message from Mackerel team director Katsuya (id:daiksy) who helped mentor the student interns over this last month.

This is the fourth year that the Mackerel team has received student interns. And the speed of development has been outstanding this year. On more than one occasion, I was surprised checking GitHub after a meeting like, "What!? This feature is already up for review ??".

After two weeks of development, today is the last day of this year’s internship. I think that this was a good experience for the student interns, but they also inspired the team as well. It was a very fulfilling two weeks.

It truly was a surprise that so many new features were developed and released in such a short period of time.

Now on to the update information.

An Organizations list screen has been added

View a list of the organizations that you belong to by accessing the URL below.

https://mackerel.io/orgs/

You can also access the same screen by clicking [▼] next to the [Organization Name] on the left side menu and clicking [Organizations].

From this page you can see the number of services, hosts, members, and alerts that are currently occurring for each organization. If you belong to multiple organizations, you can use this list to see the whole picture, like when confirming for which organization an alert is occurring.

API added to post metadata for Services/Roles

Up until now, you could register metadata to hosts, but with this release, you can now register arbitrary JSON data as metadata for services/roles. For more details, refer to the Mackerel API document for Metadata.

API added to obtain monitor settings by specifying an ID

We’ve added an API that allows you to specify the target monitor setting ID and obtain settings information. The specification method is /api/v0/monitors/<monitorId>.

For more details, refer to the the Mackerel API document on Monitors.

API added to register/delete notification channels

This API is currently only supported for email notifications and Slack. With this release, information that can be obtained with the notification channel list API can now be obtained in more detail with email notifications and Slack.

For more information, refer to the Mackerel API document on Notification Channels.

Multiple services can now be selected by filtering the Alerts list screen

It is now possible to specify multiple services with OR conditions when filtering displayed alerts in the Alerts list screen.

Multiple services can now be selected by filtering the Hosts list screen

As with the Alerts list, it is now possible to specify multiple services with OR when filtering the display in the Hosts list screen.

Thank you to all our summer interns for your hard work!

Auto-retire feature added for EC2 hosts integrated with AWS Integration etc.

Hello! Mackerel team CRE Miura (id:missasan) here.

In addition to the highly requested title feature, this update offers plenty of other content. Check out the new features provided by this summer’s Hatena Interns and some new/improvements that were made possible by user contributions. See the details below.

Now on to the update information.

An auto-retire feature has been added for EC2 hosts integrated with AWS Integration

With this update, we’ve added an automatic retirement feature for EC2 hosts integrated with AWS Integration. If this feature is enabled, retirement processing will automatically be performed in Mackerel when an instance has been terminated. To enable this option, click Enable automatic retirement in the AWS Integration Settings screen. By default, this option will be disabled for hosts that have already been created, but automatically enabled for newly created hosts.

f:id:mackerelio:20180911113923p:plain

Please note, this feature is currently only available for EC2 and should be considered when using with other AWS services.

Roles can now be registered/deleted from the API

It is now possible to register and delete roles from the API. For more details, take a look at the document below.

mackerel.io

This feature was developed by student interns participating in the 2018 Hatena Summer Internship Program under the guidance of engineers on the Mackerel development team! This was the fastest release out of all the student interns.

developer.hatenastaff.com (Japanese only)

mackerel-client-go, a golang client officially offered by Mackerel, is also supported.

Alert details added to Alert group notifications

Some detailed information included in alert groups is now displayed with notifications posted to Slack etc. Up to three alert detail items of the group can be displayed. Be sure to turn on notifications and check the display. Since Alert groups is still a new feature, we really appreciate requests and feedback.

mackerel.io

AWS Aurora PostgreSQL can now be monitored with mackerel-plugin-postgres

With the release of mackerel-agent-plugins v0.51.1, AWS Aurora PostgreSQL is now supported with mackerel-plugin-postgres.

github.com

check-smtp added

check-smtp was added in the release of go-check-plugins v0.22.0. And although check-tcp already has a feature to check smtp connection, this feature is more specialized for smtp.

github.com

To all the contributors out there who submitted Pull Requests, thank you!