#architecture

7 posts.

Kafka Active-Active Is About Ownership, Not Kafka

This post explains what Kafka can and cannot solve in Active-Active DR architectures, and why ownership, Outbox, Inbox, and failover fencing must be handled at the application level.

kafkaactive-activedisaster-recoverymsaarchitecture

Kafka 4.0 Consumer Rebalance: Coordination Moves to the Broker

Apache Kafka 4.0 made the new rebalance protocol generally available. This post explains what changes from the old protocol, why broker-side assignment matters, and what it means operationally.

kafkaconsumerrebalanceoperationsarchitecture

Kafka Streams and the EIP Aggregator: Finishing Is Harder Than Grouping

When implementing the EIP Aggregator pattern with Kafka Streams, the hard parts are not groupBy and aggregate. They are correlation keys, state stores, completion conditions, and late-event policy.

kafkakafka-streamseiparchitecturestream-processing

Why Kafka Fits Between Outbox and Inbox Patterns

This post explains why Outbox and Inbox patterns matter in asynchronous MSA flows, and why Kafka is a strong fit as the message path between them.

kafkamsaarchitecturemessagingreliability

The Large Payload Kafka Handles Well, and the One It Should Not Carry

Kafka is strong at high-volume event streams, but large file payloads can create storage amplification across the whole system.

kafkastoragearchitectureoperations

Where Kafka's Disk Is Going: Object Storage and the New Streaming Layer

A practical look at WarpStream, AutoMQ, Apache Fluss, and Kafka Diskless Topics as the Kafka ecosystem moves durable storage away from broker-local disks.

kafkastorageobject-storagearchitecture

Five Roles Redis Plays in AI Applications

A practical look at how Redis supports AI applications as a cache, session store, retrieval helper, async work layer, and operational control plane.

redisaiarchitectureoperations