Background

Breakout Session

Breaking the Bottleneck: Decentralizing Data to Power Library Innovation

Legacy designed library systems like hoopla challenged to meet rising expectations for digital services and data-driven decisions. Built over a decade ago on outdated practices, Hoopla’s architecture has become inflexible, with data silos and complex integrations that limit real-time analytics and stifle innovation.

To modernize library services, we plan to redesign the architecture using event-driven design and stream processing. Our initial research suggests that adopting this approach will offer significant benefits for Hoopla. ApacheKafka will act as the event streaming backbone, facilitating real-time dataflow between modular library domains and systems. This method will enhance data accessibility, providing domain teams with real-time insight sand reducing integration complexities, thereby breaking down silos.

For stream governance, we plan to incorporate lineage tracking and a catalog for data discovery and quality. Flink will drive powerful analytics, enabling stateful stream processing and providing instant insights fromKafka event streams.

Beyond the technology, we’ll share our journey in data architecture, including:

- The critical mindset needed to transform rigid systems and unlock data insights

- The shift from centralized to flexible, stream-based architecture

- The impact on library operations, analytics, and next-gen services

As user expectations continue to rise, libraries must innovate with their datawhile managing complex integrations. This presentation distills ourexperience into architectural patterns and strategic recommendationsthat can be applied across sectors to master insights from data in motion.Attendees will gain a model for improving data flow, empowering domainteams, and achieving agile, analytics-driven systems.

Mihir Agochiya

Midwest Tape

Ram Surabi

Midwest Tape

Download