Dynatrace Integration

The Gremlin Dynatrace integration sends Dynatrace Events whenever you run an experiment, Scenario, or reliability test. This lets you overlay test events on top of your dashboards to pinpoint exactly how and when Gremlin experiments occur, and how they impact your metrics. You can also view, rerun, and halt Gremlin experiments from your Dynatrace Event Stream.‍

‍

Data transmitted

The Dynatrace integration only sends events to Dynatrace when experiments are started or stopped in Gremlin.‍

Events are of type CUSTOM_INFO and are attached (via entitySelector to either Kubernetes objects or direct EntityIds on UserDefinedServices. To tag UserDefinedServices with a Dynatrace EntityId: add a tag with key dynatrace-entity-id and value of the EntityId (eg. CLOUD_APPLICATION-B034359570C760BD).

An example of the data in Dynatrace:

{
   "correlationId" : "d336fad89390f85a",
   "endTime" : 1757008702661,
   "entityId" : {
      "entityId" : {
         "id" : "CLOUD_APPLICATION-D55F3C830196F516",
         "type" : "CLOUD_APPLICATION"
      },
      "name" : "my-example-deployment"
   },
   "eventId" : "-7216144416740554839_1757007801591",
   "eventType" : "CUSTOM_INFO",
   "properties" : [
      {
         "key" : "dt.event.title",
         "value" : "Gremlin Attack"
      },
      {
         "key" : "gremlin-event-type",
         "value" : "START"
      },
      {
         "key" : "gremlin-experiment-id",
         "value" : "e6522650-89b6-12f0-8ca8-262b5758a7e4"
      },
      {
         "key" : "gremlin-impact-type",
         "value" : "CPU"
      },
      {
         "key" : "gremlin-team-id",
         "value" : "a7352a6b-a9a0-513c-81e4-980f680a70c1"
      }
   ],
   "startTime" : 1757007801593,
   "status" : "CLOSED",
   "title" : "Gremlin Attack",
}

‍

‍

How to set up the integration

To enable the Dynatrace integration:

1. Create valid Dynatrace access token or a valid personal access token (see Dynatrace API - Tokens and Authentication for more information)
   
   1. this will require events.ingest scope, though if you're reusing a token for health checks you may require additional scopes
2. Log into Gremlin and navigate to your Company Settings.
3. Under Integrations, click Add next to the Dynatrace icon.
4. Enter your access token in the Dynatrace API key field.
5. Enter the hostname (and protocol) in the Dynatrace Url field (should look like: https://{your-environment-id}.live.dynatrace.com/api/v2 or https://{your-activegate-domain}:9999/e/{your-environment-id}/api/v2/ )
6. Click Save.

‍

Privileges Required