Recommended Scenario

Linux region evacuation

Test your Linux-hosted service's availability when an entire cloud region becomes unavailable. Verify that traffic automatically fails over to backup regions without impacting the user experience.

Experiment types

Blackhole

Targets

Linux

Length

5 minutes

How it works

How this Scenario works

This Scenario drops all network traffic to your Linux hosts in a specified cloud region, simulating a catastrophic regional outage. This forces your global load balancers and DNS-based routing to redirect all traffic to Linux hosts in your backup region(s).

Use cases

Why run this Scenario?

Large-scale infrastructure outages are an unfortunate reality. Power outages happen, storms flood data centers, and curious sharks will snack on data cables. This Scenario tests your systems to see how they handle an entire cloud region suddenly becoming unavailable.

  • Verify that your backup regions have sufficient Linux host capacity to absorb the full production workload.
  • Validate that global load balancers and DNS failover detect the regional outage and route traffic correctly.
  • Test data replication and consistency across regions for services running on Linux infrastructure.
  • Ensure that traffic returns to normal routing once the failed region is back online.
Result

What to expect when you run it

When a region becomes unavailable, traffic automatically fails over to Linux hosts in backup regions, and those regions handle the increased load without impacting the user experience.

Run this Scenario
Keep going

More Scenarios to try

Kubernetes packet loss

Ensure your Kubernetes systems can detect and route around resources that fail health checks. This Scenario gradually increases packet loss to validate liveness/readiness probe and load balancer behavior.

Container packet loss

Ensure your containerized systems can detect and route around resources that fail health checks. This Scenario gradually increases packet loss to validate health check and load balancer behavior.

Windows packet loss

Ensure your Windows systems can detect and route around resources that fail health checks. This Scenario gradually increases packet loss to validate health check and load balancer behavior.

Avoid downtime. Use Gremlin to turn failure into resilience.

Gremlin empowers you to proactively root out failure before it causes downtime. See how you can harness chaos to build resilient systems by requesting a demo of Gremlin.

get started
Product Hero ImageShape