Kafka broker load on Linux processing latency

Description

Test the impact of I/O pressure on Kafka broker throughput and partition synchronization on Linux hosts. As disk I/O usage increases on the broker's host, pipeline performance will decrease, but should stay within expected bounds.

What this Scenario does

This Scenario generates I/O load on the Linux host where your Kafka broker runs, simulating conditions like disk contention from co-located workloads or degraded storage performance. It lets you observe how your Kafka cluster handles constrained I/O at the host level.

Why run this Scenario?

  • Validate that Kafka broker performance degrades gracefully under I/O pressure on bare-metal or VM-based Linux infrastructure.
  • Identify I/O throughput thresholds where partition replication lag becomes a risk.
  • Verify that host-level monitoring detects I/O saturation and triggers alerts before pipeline throughput is impacted.
  • Understand the relationship between Linux host I/O capacity and Kafka cluster health.

Expected outcome

When disk I/O load increases on a Linux host running a Kafka broker, pipeline throughput decreases predictably and partition replication remains synchronized within acceptable thresholds.

Target
Linux
Linux
Experiments
IO
IO
Preview
Runtime:  
4 minutes