Test Cloud Composer reliability with Gremlin Failure Flags. Inject latency and errors into Airflow tasks to validate retries and failure branches.
Cloud Composer makes dependencies between tasks explicit, which is Airflow's strength and also the reason one stuck task can hold up everything scheduled behind it. A DAG waiting on an operator that will never return doesn't fail. It stops making progress, and the state reads as work in progress rather than a problem.
Scheduled pipelines compound this. A daily DAG that hangs may block the next run or start it concurrently, depending on configuration. Either way, several days can pass before anyone downstream notices the output stopped arriving.
Add Failure Flags to your custom operators and you can inject latency or errors at a specific task while the DAG runs. You'll learn whether your tasks have real timeouts, whether retries fire the way the DAG definition suggests, and whether your alerting distinguishes between a task that's running and one that's stuck.
For orchestration, that distinction is the whole game, and it defaults to unmonitored unless someone configured otherwise.
Dependencies: Failure Test
Simulate a failed dependency by dropping all network traffic to the dependency.
Dependencies: Latency Test
Recreate poor network conditions by delaying all network traffic to a dependency by 100ms.
Unreliable Networks - Dependencies
Simulate unreliable network conditions when communicating with dependencies by adding latency to API calls. Test whether your users are affected when dependency response times degrade.
* Failure Flags works wherever you can add the SDK to your application and run the Gremlin sidecar. Not every language and platform combination has been individually tested, and not all are officially supported. Check our compatibility documentation for what's verified, or get in touch if you don't see your runtime.
Intelligent Health Checks - GCP
Automatically monitor your Google Cloud services during testing in one-click with Intelligent Health Checks.
Avoid downtime. Use Gremlin to turn failure into resilience.
Gremlin empowers you to proactively root out failure before it causes downtime. See how you can harness chaos to build resilient systems by requesting a demo of Gremlin.
.svg)