Search documentation
Dashboard
Reliability Management
Golden signals

PagerDuty Golden Signal

To create a Service, you must add at least one Golden Signal monitor to your Service definition. Gremlin recommends a combination of 3 to 5 monitors for a well-rounded view of your Service’s health. Once you have selected a Service type, defined its fingerprint, and selected a process, you'll be able to start adding Golden Signal monitors to your Service.

Adding a PagerDuty Golden Signal Monitor

The PagrDuty Incident or Service ID URL must point to a previous or current PagerDuty incident, or a defined Pagerduty service relevant to the Service you are creating in Gremlin. You can get this from the PagerDuty web app. See List incidents in the PagerDuty documentation for more information.

Example incident or serviceInput value
Any triggered incidents (web)https://acm.eu.pagerduty.com/incidents?status=triggered
Any triggered incidents (API)https://api.pagerduty.com/incidents?statuses[]=triggered
Specific incident with ID (web)https://acm.eu.pagerduty.com/incidents/Q2K42T1G8
Specific incident with ID (API)https://api.pagerduty.com/incidents?statuses[]=triggered&service_ids[]=PE8X
All services and any incident raised (web)https://andcm.eu.pagerduty.com/service-directory?direction=asc&query=&sort_by=name&team_ids=all
All services and any incident raised (API)https://api.pagerduty.com/incidents?statuses[]=triggered
Specific service by ID and any incident raised on it (web)https://andcm.eu.pagerduty.com/service-directory?direction=asc&query=&sort_by=name&team_ids=all
Specific service by ID and any incident raised on it (API)https://api.pagerduty.com/incidents?statuses[]=triggered

To add a PagerDuty Golden Signal:

  • Select PagerDuty from the Integrations drop-down and click Add.

  • If the PagerDuty integration has been authenticated in Team Settings, you will only see the PagerDuty Incident or Service ID URL box — in this case, go to the next step. If the API key and application key have not been defined for the team, you'll also see the Authentication and Headers section — in this case, you'll need to set up the PagerDuty team integration first.

    Add PagerDuty Golden Signal monitor to Service

  • In the PagerDuty web app, copy the Incident or Service ID URL of the monitor you want to use.

  • Back in the Gremlin web app, update the PagerDuty Incident or Service ID URL with the PagerDuty Incident or Service ID.

  • Click Test Golden Signal. Gremlin will validate the JSON response and look for any triggered incident returned in the list associated with the input URL.

    • If the monitor is OK, the response will look similar to this: Datadog test OK

    • If the monitor is in another state like Alert, Ignored, No Data, Skipped, Unknown, or Warn, you can still save the Golden Signal, but it will not evaluate to successful once a Reliability Test is run, impacting the Service's Reliability Score.

  • Click Save.

Editing a Golden Signal Monitor

To edit a Golden Signal Monitor, go to the specific Service, click Settings, and then click the Golden Signals tab.

Edit Datadog Golden Signal example