Kafka broker load on container processing latency
Test the impact of I/O usage on pipeline throughput and partition synchronicity. As I/O usage increases, pipeline performance will decrease, but should stay within expected bounds. Be sure to select your Kafka nodes.
IO
Containers
4 minutes
How this Scenario works
This Scenario generates I/O load within the container running your Kafka broker, simulating storage contention or degraded volume performance in a containerized deployment. It lets you observe how your Kafka cluster handles constrained I/O when running in containers.
In containerized environments, this Scenario validates that your Kafka brokers can handle I/O pressure while running alongside other workloads. It helps identify any resource contention issues that may arise in shared container environments.
Why run this Scenario?
- Validate that container-level I/O limits and storage drivers handle Kafka's disk demands without unexpected failures.
- Identify how container storage constraints (such as volume IOPS limits) affect partition replication lag.
- Verify that container resource limits are configured to support Kafka broker performance under load.
- Understand how shared storage in containerized environments impacts Kafka throughput.
What to expect when you run it
When disk I/O load increases on a container running a Kafka broker, pipeline throughput decreases predictably and partition replication stays synchronized within acceptable thresholds.
More Scenarios to try
Avoid downtime. Use Gremlin to turn failure into resilience.
Gremlin empowers you to proactively root out failure before it causes downtime. See how you can harness chaos to build resilient systems by requesting a demo of Gremlin.
.svg)