Dashboard
Reliability Management

Reliability Score

The Reliability Score helps set a standard view of reliability across all teams and services in your organization. Once you define your Service and run Gremlin's pre-defined Reliability tests across common reliability risks, Gremlin will calculate the Reliability Score for your Service.

How the Reliability Score is calculated

A Reliability Score is a calculated value between 0 and 100 representing a Service's reliability. The reliability score is calculated using the following method:

  • Each reliability test is given a score between 0 and 100 based on whether your service passed or failed.
  • Tests are grouped into different categories. Each category has a score that averages the tests in that category.
  • The scores from every category are added up and averaged to provide the service's reliability score.

Each reliability test can have one of four scores depending on whether the test was successful, failed, not yet run, or if it was successful but is outdated (i.e. hasn't been run within the past month). The value of these scores is shown here:

Test StatusScore
Passed100
Expired (passed, but hasn't been run in a week)75
Failed50
Not yet run0

Test categories

Note
These categories may vary depending on which Test Suite your team is using.

Reliability tests are grouped into the following categories:

  • Redundancy
  • Scalability
  • Dependencies
  • Other

In addition, Gremlin has a separate category for Detected Risks. Detected Risks are automatically identified and don't require running a reliability test, but they contribute to the service's reliability score.

The individual test scores from each category are added up and averaged to provide the total Reliability Score. Note that certain categories may not appear if Gremlin detects that it's not relevant to the service (e.g. if it has no dependencies or no relevant detected risks). Categories that aren't listed have no impact on the final score.


No items found.
Previous
Previous
This is some text inside of a div block.
Compatibility
Installing the Gremlin Agent
Authenticating the Gremlin Agent
Configuring the Gremlin Agent
Managing the Gremlin Agent
User Management
Integrations
Health Checks
Notifications
Command Line Interface
Updating Gremlin
Reliability Management (RM) Quick Start Guide
Services and Dependencies
Detected Risks
Reliability Tests
Reliability Score
Targets
Experiments
Scenarios
GameDays
Overview
Deploying Failure Flags on AWS Lambda
Deploying Failure Flags on AWS ECS
Deploying Failure Flags on Kubernetes
Classes, methods, & attributes
API Keys
Examples
Container security
General
Linux
Windows
Chao
Helm
Glossary
Additional Configuration for Helm
Amazon CloudWatch Health Check
AppDynamics Health Check
Blackhole Experiment
CPU Experiment
Certificate Expiry
Custom Health Check
Custom Load Generator
DNS Experiment
Datadog Health Check
Disk Experiment
Dynatrace Health Check
Grafana Cloud Health Check
Grafana Cloud K6
IO Experiment
Install Gremlin on Kubernetes manually
Install Gremlin on OpenShift 4
Installing Gremlin on AWS - Configuring your VPC
Installing Gremlin on Kubernetes with Helm
Installing Gremlin on Windows
Installing Gremlin on a virtual machine
Installing the Failure Flags SDK
Jira
Latency Experiment
Memory Experiment
Network Tags
New Relic Health Check
Overview
Overview
Overview
Overview
Overview
Packet Loss Attack
PagerDuty Health Check
Preview: Gremlin in Kubernetes Restricted Networks
Private Network Integration Agent
Process Collection
Process Killer Experiment
Prometheus Health Check
Configuring Role Based Access Control (RBAC)
Running Failure Flags experiments
Scheduling Scenarios
Shared Scenarios
Shutdown Experiment
Slack
Managing Teams
Time Travel Experiment
Troubleshooting Gremlin on OpenShift
User Authentication via SAML and Okta
Managing Users
Webhooks
Integration Agent for Linux
Test Suites
Restricting Testing Times
Reports
Process Exhaustion Experiment
Enabling DNS collection
Authenticating Users with Microsoft Entra ID (Azure Active Directory) via SAML
AWS Quick Start Guide
Installing Gremlin on Amazon ECS