How Alpakka Uses Flow Control Optimizations In Apache Kafka 2.4
Original post on Lightbend’s blog, Archived PDF
This blog post begins with details about how the Kafka Consumer and Alpakka Kafka internals are designed to facilitate asynchronous polling and back-pressure. We’ll discuss how the Consumer’s flow control mechanisms were improved in KAFKA-7548 to provide better performance. We conclude with some benchmarks that demonstrate the performance improvements before and after the new Consumer is used.