Test AWS Batch reliability with Gremlin. Simulate process crashes and disk pressure to validate job rescheduling in EC2 compute environments.
Batch jobs fail differently from user-facing services. Nobody is watching, so there's no immediate signal. Failures surface hours later and somewhere else, usually as a missing report, an incomplete dataset, or a downstream job that started on schedule with nothing to process.
That delay is the real cost. By the time anyone notices, the window to rerun cleanly may have closed, and you're reconciling partial output against a deadline. Compute environments that lose an instance mid-job can leave work in a state that's harder to recover from than an outright failure would have been.
Testing your compute environment tells you what your jobs do when an instance disappears partway through: whether they resume, restart cleanly, or quietly produce incomplete results. The last outcome is the dangerous one, and it's the one you're least likely to catch without deliberately looking for it.
Host failure - Linux
Prepare for Linux host failures by shutting down a percentage of your hosts and observing the results. Validate that your infrastructure handles host loss without impacting service availability.
Scalability: Disk I/O
Test that your service scales as expected when Disk I/O is limited. Gremlin will carry out many read and write operations in the target's /var/tmp directory. Estimated test length: 20 minutes.
Host redundancy - Linux
Test resilience to host failures by shutting down a randomly selected Linux host. Verify that your platform automatically restarts or replaces it.
* Gremlin is designed to work on any cloud platform that provides Linux or Windows hosts. We haven't individually tested every service we cover, and not all are officially supported. Check our compatibility documentation for tested operating systems and known caveats, or get in touch if you don't see yours.
Intelligent Health Checks - AWS
Automatically monitor your AWS services during testing in one-click with Intelligent Health Checks.
AWS integration
Integrate Gremlin with your AWS account for automatic Health Check creation, service discovery, and more.
Troubleshooting Failure Flags
Diagnose and resolve common issues with Failure Flags, Gremlin's application-based fault injection feature.
Using Failure Flags by proxy
Use Failure Flags, Gremlin's application-level fault injection feature, without changing a single line of code.
Reliability Intelligence: Spread load across replicas to reduce error spikes
Reduce error spikes during replica termination by spreading traffic more evenly across a larger number of pods.
Installing Gremlin on Amazon ECS
Learn how to install Gremlin on EC2-backed Amazon Elastic Container Service (ECS) deployments.
Installing Gremlin on AWS - Configuring your VPC
Amazon Web Services (AWS) has unique networking requirements that must be implemented for Gremlin to run successfully…
Amazon CloudWatch Health Check
Learn how to monitor the health of your systems during testing by using your existing AWS CloudWatch alarms.
Deploying Failure Flags on AWS ECS
This document will walk you through setting up Failure-Flags-Sidecar for your ECS Tasks. Failure-Flags-Sidecar runs…
Deploying Failure Flags on AWS Lambda
This document will walk you through setting up the Failure Flags agent for Lambda Functions. The Failure Flags agent…
Failure Flags
Gremlin Failure Flags lets you run Chaos Engineering experiments and reliability tests on serverless workloads…
Scenarios
A Scenario is a set of Health Checks and Gremlin experiments that you can define, along with a name, description…
Experiments
An experiment is a method of injecting failure into a system in a simple, safe, and secure way. Learn how easy it is to run experiments in Gremlin.
Targets
A target is any infrastructure or application resource that you can run experiments on. This can include Amazon EC…
Services
Gremlin tests your services to ensure they're resilient to traffic surges, network latency, cloud provider blackouts, and more. Learn how in our docs.
Configuring the Gremlin Agent
This documentation page shows you how to configure the Gremlin Agent. You can configure Gremlin using either environment…
Avoid downtime. Use Gremlin to turn failure into resilience.
Gremlin empowers you to proactively root out failure before it causes downtime. See how you can harness chaos to build resilient systems by requesting a demo of Gremlin.
