Learn OPEN TABLE FORMAT before it's TOO LATE | Modern Data Engineering 2025

Delta Lake | Apache Spark | Databricks | Apache Iceberg | Apache Hudi This video is a complete beginner-friendly course on Open Table Formats like Delta Lake, Apache Iceberg, and Apache Hudi, using Databricks, PySpark, and Azure Data Lake. Timestamps: 0:00 Introduction 05:14 What are Open Table Formats 20:44 Databricks Overview 25:59 Databricks Spark Cluster 28:27 Data Ingestion to Databricks using PySpark 39:37 Delta Lake Explained 47:09 Delta Log Explained 50:06 Delta Tables in Databricks 57:04 Transactions in Delta Log 1:06:44 DML Operations in Delta Lake 1:21:38 Data Versioning in Delta Lake 1:23:28 Time Travel (RESTRORE) in Delta Lake 1:25:53 VACUUM in Databricks with Delta Lake 1:42:27 Schema Changes in Delta Lake Databricks 1:54:26 Spark Optimization Techniques in Delta Lake 2:25:50 Deletion Vectors with Azure Data Lake 2:49:59 Spark Structured Streaming WATCH MY PREVIOUS VIDEOS ➡️Azure End To End Data Project https://youtu.be/uc-u_juRg-w?si=sO_CavjnhNaSnZri ➡️Databricks Tutorial https://youtu.be/7pee6_Sq3VY?si=pPBrTnE2R8PhhHu5 ➡️PySpark Full Course https://youtu.be/94w6hPk7nkM?si=i3u_8ZWkGf6fiGyh REPOSITORY ➡️GitHub https://github.com/anshlambagit/OpenTableFormat ======================================= Join this channel to SUPPORT MY HARDWORK: https://www.youtube.com/channel/UCu7lQE-L5gzt8aD7zuuufjw/join ======================================= Connect with ME LinkedIn - https://www.linkedin.com/in/ansh-lamba-793681184/ Telegram - https://t.me/anshlambadatafam ========================= For COLLABORATION 👇 anshlambacollab@gmail.com ========================= ⭐Hashtags⭐ #azure #databricks #pyspark