Gremlin and AWS RDS

Test how your application handles an AWS RDS outage. Run Gremlin network experiments and reliability tests to validate timeouts and failover.

Why RDS reliability is important

Amazon RDS is the dependency with the widest blast radius in most architectures. Dozens of services share it, so a few seconds of unavailability degrades everything at once. Connection pools exhaust, requests queue, and the pressure travels upstream faster than your team can respond to it.

Managed failover helps, but it's not instant. What happens to in-flight transactions, how quickly your pool notices a dead socket, and whether your application reconnects without a restart are all properties of your code. With Gremlin, you can:

  • Rehearse a failover before AWS schedules one. Blackhole experiments make the RDS endpoint unreachable from your application, reproducing exactly what a failover looks like from the client side. You learn how long recovery takes and whether it needs human intervention.
  • Find the timeouts that nobody tuned. Latency experiments slow the connection so you can watch requests back up. Most teams discover their database timeout is longer than the timeout of the service calling them, which turns one slow query into a cascade.
  • Score every service that touches the database. Gremlin maps your dependencies automatically, so RDS shows up wherever it's used. Reliability Tests then score each dependent service, giving you a ranked list of what to fix first.

Nearly everything you run sits downstream of this database. Finding and fixing its failure modes is the best step you can take for your applications.

Building resilience on RDS with Gremlin

RDS is a dependency: a managed service that your service connects to. You can run tests by deploying the Gremlin agent or Failure Flags sidecar to a service that consumes RDS*. Using the experiments shown to the right, you can prepare your service for RDS failure modes, including:

  • Network outages making RDS unavailable
  • Slow performance due to network latency
  • Expiring TLS certificates
You can also run these expert-built workflows designed to replicate real-world failure modes on RDS:

* Testing a dependency doesn't require installing anything on it. Gremlin runs the experiment from the service that calls it, so compatibility depends on that host rather than on the dependency itself. Check our compatibility documentation for supported operating systems and platforms, or get in touch if you don't see yours.

resources

Learn more about Gremlin and RDS

All product names, logos, and brands are property of their respective owners. AWS is a trademark of Amazon.com, Inc.; Azure is a trademark of Microsoft Corporation; Google Cloud is a trademark of Google LLC. Use of these names is for identification purposes only and does not imply endorsement or affiliation unless otherwise stated.

Avoid downtime. Use Gremlin to turn failure into resilience.

Gremlin empowers you to proactively root out failure before it causes downtime. See how you can harness chaos to build resilient systems by requesting a demo of Gremlin.

Product Hero ImageShape