Client Cannot Communicate - Lessons From a Decade of Kafka Consulting

We rightly celebrate the successes of high-profile Kafka projects, but what about the less visible failures? Let's delve into the invaluable lessons learned from these disappointments. Allow me to unveil the hidden truths of avoidable failures—strategies that can compromise your project's success, sabotage your engineering endeavors, and subtly diminish your team's productivity. Drawing from extensive experience across numerous Kafka projects in various sectors such as banking, transportation, retail and product development, I've collected my fair set of scars and lessons from the field that everyone should know, including  

• Common mistakes with broker and client configuration
• Serialization choices and when JSON and AVRO matters
• Schema management and evolution
• What to measure and what should be monitored  - Addressing cyb
• Adopting client libraries
• How to help developerser concerns and managing odd decisions in the name of Kafka security or compliance  
• ‍

Let me share the hard lessons learned for building awesome streaming applications so you don’t have to ruin your next Kafka project.