Evolving the Data Supply Chain: Powering Real-Time Analytics & GenAI with Flink, Iceberg, and Trino

In the rapidly evolving landscape of data-driven enterprises, the ability to harness and process vast amounts of information in real-time is paramount. This talk will revisit the concept of the Data Supply Chain, a framework that enables AI at an enterprise scale, and explore cutting-edge technologies that are transforming data streaming and processing capabilities.

Building on insights from last year's presentation (https://www.youtube.com/watch?v=Zp86b_eaW8g), we will delve into the use of Apache Flink for stream processing, providing a foundation for real-time decision-making and AI applications.

We will introduce Tableflow, a tool for Kafka-to-Iceberg materialization. This integration enhances data accessibility, ensuring that data is readily available for analytics and AI workloads.

The talk will also highlight the role of Starburst Trino in enabling real-time analytics and agentic workloads over Iceberg tables. By leveraging Trino's powerful uniform data access layer (query engine), enterprises can perform complex analytics on large datasets with unprecedented speed and efficiency. This capability is crucial for organizations aiming to derive actionable insights and drive innovation through AI.

Join us as we explore these transformative technologies and their impact on the Data Supply Chain. Attendees will gain valuable insights into optimizing their data infrastructure to support AI initiatives and achieve enterprise-scale success. This session is ideal for data & AI strategists, data engineers, architects, and decision-makers looking to enhance their data streaming capabilities and unlock the full potential of AI in their organizations.