Lidl's Journey with Real-Time ERP, Snowflake, and Apache Iceberg

Lidl, Europe’s largest retailer, operates in 32 countries with 10,000+ stores and a single ERP system. Recently, it redesigned its ERP analytics platform for near-real-time data, cost-efficiency, and flexibility. This talk shares how Snowflake and Apache Iceberg transformed the data infrastructure. The presenters show how they tackled challenges in managing pipelines, creating CDC-based Iceberg tables, data freshness, scalability, schema evolution, data quality, and cost-effective analytics querying in Snowflake.