Future of Streaming: Emerging trends for event driven architectures

JPMC is undertaking a significant data transformation by implementing a next-generation data streaming platform, moving beyond traditional mainframe dependencies. This initiative addresses several challenges, including the expense of mainframe queries, excessive data duplication, silos, high data gravity within the mainframe, and a lack of real-time capabilities that have prevented effective data leverage for critical initiatives like Agentic AI.

The strategy involves establishing Kafka as the authoritative copy of data, which facilitates the creation of a centralized source of truth. This approach enables the development of real-time data products that aim for high quality, availability, and global accessibility. By embedding best practices from the outset, such as schema management, Role-Based Access Control (RBAC), and robust metadata, JPMC seeks to ensure that its data is of high quality, secure, and easily discoverable across the enterprise.

This foundation is crucial for modernization, supporting Agentic AI and stream operations by providing a reliable and high-quality data backbone. The ability to effectively deliver high-quality, discoverable data with contracts and SLAs is seen as the pivot around which future modernization will occur, moving towards a more automated, non-manual operating environment. This strategic investment allows JPMC to enhance its capabilities and prepare for new innovations.