Kafka broker load on Linux processing latency
Description
Test the impact of I/O pressure on Kafka broker throughput and partition synchronization on Linux hosts. As disk I/O usage increases on the broker's host, pipeline performance will decrease, but should stay within expected bounds.
What this Scenario does
This Scenario generates I/O load on the Linux host where your Kafka broker runs, simulating conditions like disk contention from co-located workloads or degraded storage performance. It lets you observe how your Kafka cluster handles constrained I/O at the host level.
Why run this Scenario?
- Validate that Kafka broker performance degrades gracefully under I/O pressure on bare-metal or VM-based Linux infrastructure.
- Identify I/O throughput thresholds where partition replication lag becomes a risk.
- Verify that host-level monitoring detects I/O saturation and triggers alerts before pipeline throughput is impacted.
- Understand the relationship between Linux host I/O capacity and Kafka cluster health.
Expected outcome
When disk I/O load increases on a Linux host running a Kafka broker, pipeline throughput decreases predictably and partition replication remains synchronized within acceptable thresholds.