#storage

5 posts.

The Kafka Partition Looks Fine, but the Disk Is Full

Kafka 4.3 adds Partition Size Percentage metrics for retention pressure, but Kafka operators still need physical free-space monitoring for log.dirs.

kafkastoragemonitoringoperationstesting

Before Removing a Kafka Broker, Cordon First

Apache Kafka 4.3 introduced cordoned.log.dirs. This post explains what it means, how to use it, and why disk or broker decommissioning should start by blocking new replica placement.

kafkaoperationsstoragedecommissionmaintenance

The Large Payload Kafka Handles Well, and the One It Should Not Carry

Kafka is strong at high-volume event streams, but large file payloads can create storage amplification across the whole system.

kafkastoragearchitectureoperations

The Kafka Broker Slowed Down, but Kafka Was Not the Cause

A practical incident-style walkthrough of a Kafka broker throughput drop, follower replicas falling out of ISR, and the storage path contention below the VM.

kafkaoperationsstorageobservability

Where Kafka's Disk Is Going: Object Storage and the New Streaming Layer

A practical look at WarpStream, AutoMQ, Apache Fluss, and Kafka Diskless Topics as the Kafka ecosystem moves durable storage away from broker-local disks.

kafkastorageobject-storagearchitecture