Kafka broker load on container processing latency

What this Scenario does

This Scenario generates I/O load within the container running your Kafka broker, simulating storage contention or degraded volume performance in a containerized deployment. It lets you observe how your Kafka cluster handles constrained I/O when running in containers.

In containerized environments, this Scenario validates that your Kafka brokers can handle I/O pressure while running alongside other workloads. It helps identify any resource contention issues that may arise in shared container environments.

‍

Why run this Scenario?

• Validate that container-level I/O limits and storage drivers handle Kafka's disk demands without unexpected failures.
• Identify how container storage constraints (such as volume IOPS limits) affect partition replication lag.
• Verify that container resource limits are configured to support Kafka broker performance under load.
• Understand how shared storage in containerized environments impacts Kafka throughput.

‍

Expected outcome

When disk I/O load increases on a container running a Kafka broker, pipeline throughput decreases predictably and partition replication stays synchronized within acceptable thresholds.