Git Product home page Git Product logo

awscloudwatch-docker's Introduction

AWS Cloudwatch

Cloudwatch is an Amazon Web Service that is available when you spin up an EC2 instance. In order to configure this integration, you must sign up for an EC2 instance by going Here.

In this lab, I am using a Amazon Linux AMI

Prerequisites

  • You must download and import the AWS Communication Plan titled AWSCloudWatch.zip into your xMatters instance. You can find the file in this repo
  • Slight familiarity with AWS

Step 1: Configure Your IAM Role or User for CloudWatch Logs

The CloudWatch Logs agent supports IAM roles and users. If your instance already has an IAM role associated with it, make sure that you include the IAM policy below. If you don't already have an IAM role assigned to your instance, you can use your IAM credentials for the next steps or you can assign an IAM role to that instance. For more information, see Attaching an IAM Role to an Instance.

  • To configure your IAM role or user for CloudWatch Logs
  1. Open the IAM console at https://console.aws.amazon.com/iam/.

  2. In the navigation pane, choose Roles.

  3. Choose the role by selecting the role name (do not select the check box next to the name).

  4. On the Permissions tab, expand Inline Policies and choose the link to create an inline policy.

  5. On the Set Permissions page, choose Custom Policy, Select.

  6. For more information about creating custom policies, see IAM Policies for Amazon EC2 in the Amazon EC2 User Guide for Linux Instances.

  7. On the Review Policy page, for Policy Name, type a name for the policy.

  8. For Policy Document, paste in the following policy:

  "Version": "2012-10-17",
  "Statement": [
    {
      "Effect": "Allow",
      "Action": [
        "logs:CreateLogGroup",
        "logs:CreateLogStream",
        "logs:PutLogEvents",
        "logs:DescribeLogStreams"
    ],
      "Resource": [
        "arn:aws:logs:*:*:*"
    ]
  }
 ]
}

Step 2: Configure a SNS Topic and Subscription

  1. Click on the Amazon Simple Notification Service

AWS SNS Logo

  1. Create a topic

AWS SNS Topic Logo

3.) Create a Subscription

AWS Subscription Logo

  • Make sure the end point is protocol is https
  • Take the ARN from your previous topic and paste it into the ARN field
  • In the endpoint field, grab the endpoint from the integration builder in "Inbound from SNS" in your AWS Cloudwatch Communication Plan.

XM Comm Plan Outbound Logo

Step 3: Install and Configure CloudWatch Logs on an Existing Amazon EC2 Instance

The process for installing the CloudWatch Logs agent differs depending on whether your Amazon EC2 instance is running Amazon Linux, Ubuntu, CentOS, or Red Hat. Use the steps appropriate for the version of Linux on your instance. However, remember, in this example we are using a Amazon Linux instance

To install and configure CloudWatch Logs on an existing Amazon Linux instance

Starting with Amazon Linux AMI 2014.09, the CloudWatch Logs agent is available as an RPM installation with the awslogs package. Earlier versions of Amazon Linux can access the awslogs package by updating their instance with the sudo yum update -y command. By installing the awslogs package as an RPM instead of the using the CloudWatch Logs installer, your instance receives regular package updates and patches from AWS without having to manually reinstall the CloudWatch Logs agent.

Warning

Do not update the CloudWatch Logs agent using the RPM installation method if you previously used the Python script to install the agent. Doing so may cause configuration issues that prevent the CloudWatch Logs agent from sending your logs to CloudWatch.

  1. Connect to your Amazon Linux instance. For more information, see Connect to Your Instance in the Amazon EC2 User Guide for Linux Instances.

If you have trouble connecting, see Troubleshooting Connecting to Your Instance in the Amazon EC2 User Guide for Linux Instances.

  1. Update your Amazon Linux instance to pick up the latest changes in the package repositories.
  • sudo yum update -y
  • sudo yum install -y awslogs
  • Edit the /etc/awslogs/awscli.conf file and in the [default] section, specify the region in which to view log data and add your credentials.
       region = us-east-1
       aws_access_key_id = <YOUR ACCESS KEY>
       aws_secret_access_key = <YOUR SECRET KEY> 
    
  1. Install apache web service by running sudo yum install httpd. One Apache is installed, start the service by running service httpd start
  2. Next, we will need to configure which logs we want to track
  • We will do this by downloading the following script wget https://s3.amazonaws.com/aws-cloudwatch/downloads/awslogs-agent-setup-v1.0.py
  • And then running the following sudo python ./awslogs-agent-setup-v1.0.py --region us-east-1
  • When prompt, input your AWS Access Key ID
  • When prompt, input your AWS Secret Access Key
  • You can leave the default region name blank
  • You can leave the default output format blank
  • When prompt for the Log stream name, enter option 3 and type "Apache Error Logs"
  • Chose a timestamp for your output
  • One the configuration is complete you should run sudo service awslogs restart

Script logo

  1. Head over to AWS Cloudwatch

AWS CloudWatch Logo

6 Click on Logs

AWS Logs logo

7.) You should see your apache logs

AWS Apache Logs Logo

Step 4: Configure a Metric in the Logs

  1. After your logs are being sent to CloudWatch, In the CloudWatch console click on Logs
  2. Find your Apache logs
  3. Click on Create Metric Filter
  4. In the Filter Pattern type shutting down
  5. Define the Metric

Define Metric

  1. Name the filter shutting-down
  2. Name the Metric apacheShutDown

Assign Metric

Step 5: Configure a Alarm in CloudWatch

  1. Go back to the CloudWatch Console
  2. Click on Alarm
  3. Click on Create Alarm
  4. Name the alarm apache is down
  5. Description Apache Web Service has stopped
  6. Whenever: apacheShutDown is >=1 for 1 consecutive period
  7. Whenever this alarm: State is ALARM
  8. Send notification to Send_to_XM

AWS Alarm

Step 6: Stop Apache

  1. Log into your EC2 instance
  2. Type the following command sudo service httpd stop
  3. Your Alarm should be triggered in Cloudwatch

Alarm State

  1. You should also get an alert from xMatters telling you Apache has stopped

xM Email

Step 7: Monitoring the Docker Deamon in CloudWatch (optional)

  1. Run sudo yum update -y
  2. Install Docker by running sudo yum install -y docker
  3. The docker Deamon is located at /var/log/docker
  4. Repeat Step 3 part 4 to log the docker deamon logs
  5. Repeat Step 5 to configure your alarm in CloudWatch

awscloudwatch-docker's People

Contributors

mpeters413 avatar

Watchers

 avatar  avatar

Forkers

xmatters

awscloudwatch-docker's Issues

Instructions for implementation is incorrect

In working with the current set of instructions, I noted the following error within the installation for implementation. Here is the following correction:

  1. In step #4 it reads: "Next to the AWS - CloudWatch comm plan, click Edit > Access Permissions and give access to the user created in step 2." . This "Access Permission," is actually under the "Web Services" drop down menu.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.