DEV Community

loading...
Cover image for Using SQL with Delta Lake [Create: Data]
Microsoft Azure

Using SQL with Delta Lake [Create: Data]

Jasmine Greenaway
Brooklyn based programmer 🗽 Cloud Advocate by day, instructor and meetup organizer by night.
・1 min read

Do you work with data lakes? This session is for you! Join Jacek and I as we talk about Delta Lake, an open-source storage management system (storage layer) that brings ACID (atomicity, consistency, isolation, durability) transactions and time travel to Apache Spark and big data workloads.

This past summer, Delta Lake 0.7.0 was released for use with Apache Spark 3. It was a HUGE exciting release that also introduced full coverage of SQL DDL(data description language) and DML(Data Manipulation Language) commands. We'll be talking about this release and how Delta Lake approaches the challenges that can arise when working with data lakes.

Join us for Create: Data online event, and please put your questions in the chat and here, we are more than happy to take all your questions and thoughts with our speakers.

Discussion (0)