Workshops - Data & AI Warsaw Tech Summit

Harnessing Real-Time Analytics: Building a Cost-Effective, Resilient Data Lake and Data Mesh with CDC Tools

This presentation delves into creating a real-time analytics platform by leveraging cost-effective Change Data Capture (CDC) tools like Debezium for seamless data ingestion from sources such as Oracle into Kafka. We’ll explore how to build a resilient data lake and data mesh architecture using Apache Flink, ensuring data loss prevention, point-in-time recovery, and robust schema evolution to support agile data integration. Participants will learn best practices for establishing a scalable, real-time data pipeline that balances performance, reliability, and flexibility, enabling efficient analytics and decision-making.

Speaker

Lead Architect
Direct Line Group UK