Skip to content

Latest commit

 

History

History
 
 

README.md

Agent Check: MapR

Overview

This check monitors MapR 6.1+ through the Datadog Agent.

Setup

Follow the instructions below to install and configure this check for an Agent running on a host.

Installation

The MapR check is included in the Datadog Agent package but requires additional setup operations.

  1. Create a dd-agent user with a password on every node in the cluster with the same UID/GID so it is recognized by MapR. See Managing users and groups for additional details.
  2. Install the Agent on every node you want to monitor.
  3. Install the library mapr-streams-library with the following command: /opt/datadog-agent/embedded/bin/pip install --global-option=build_ext --global-option="--library-dirs=/opt/mapr/lib" --global-option="--include-dirs=/opt/mapr/include/" mapr-streams-python. If you use Python 3 with Agent 6, replace pip by pip3.
  4. Add /opt/mapr/lib/ to your /etc/ld.so.conf (or a file in /etc/ld.so.conf.d/). This is required to help the mapr-streams-library used by the Agent to find the MapR shared libraries.
  5. Generate a long-lived ticket for the dd-agent user.
  6. Make sure the ticket is readable by the dd-agent user.
  7. Configure the integration (see below).

Note: If you don't have "security" enabled in the cluster, you can continue without a ticket.

Configuration

Metric collection

  1. Edit the mapr.d/conf.yaml file, in the conf.d/ folder at the root of your Agent's configuration directory to collect your MapR performance data. See the sample mapr.d/conf.yaml for all available configuration options.
  2. Set the ticket_location parameter in the config to the path of the long-lived ticket you created.
  3. Restart the Agent.

Log collection

MapR uses fluentD for logs. Use the fluentD datadog plugin to collect MapR logs. The following command downloads and installs the plugin into the right directory.

curl https://raw.githubusercontent.com/DataDog/fluent-plugin-datadog/master/lib/fluent/plugin/out_datadog.rb -o /opt/mapr/fluentd/fluentd-<VERSION>/lib/fluentd-<VERSION>-linux-x86_64/lib/app/lib/fluent/plugin/out_datadog.rb

Then update the /opt/mapr/fluentd/fluentd-<VERSION>/etc/fluentd/fluentd.conf with the following section.

<match *>
  @type copy
  <store> # This section is here by default and sends the logs to ElasticCache for Kibana.
    @include /opt/mapr/fluentd/fluentd-<VERSION>/etc/fluentd/es_config.conf
    include_tag_key true
    tag_key service_name
  </store>
  <store> # This section also forwards all the logs to Datadog:
    @type datadog
    @id dd_agent
    include_tag_key true
    dd_source mapr
    dd_tags "<KEY>:<VALUE>"
    service <YOUR_SERVICE_NAME>
    api_key <YOUR_API_KEY>
  </store>

Refer to fluent_datadog_plugin documentation for more details about the options you can use.

Validation

Run the Agent's status subcommand and look for mapr under the Checks section.

Data Collected

Metrics

See metadata.csv for a list of default metrics provided by this integration.

Service Checks

  • mapr.can_connect: Returns CRITICAL if the Agent fails to connect and subscribe to the stream topic, OK otherwise.

Events

The MapR check does not include any events.

Troubleshooting

Need help? Contact Datadog support.