How to Remove Duplicate Rows with PySpark in Databricks
Learn how to remove duplicate rows with PySpark in Databricks using dropDuplicates, distinct and Window to keep only th…
4 min
16 Jul 2026
How to Use Time Travel on a Delta Table in Databricks
Learn how to use Time Travel on a Delta table in Databricks: inspect the history, query older versions and restore the …
4 min
12 Jul 2026
How to reuse notebooks with %run in Databricks
Learn how to reuse code across notebooks in Databricks with the %run command. A step-by-step guide with a practical exa…
4 min
09 Jul 2026
How to read a CSV file into a DataFrame in Databricks
Learn how to read a CSV file into a DataFrame in Databricks with PySpark. A step-by-step guide with spark.read, header,…
4 min
07 Jul 2026
How to create widgets in a Databricks notebook: step by step
Learn how to create widgets in a Databricks notebook with dbutils.widgets: parameterize dates and tables and reuse the …
4 min
05 Jul 2026
How to upsert a Delta table in Databricks with MERGE
Learn how to upsert a Delta table in Databricks using the MERGE command: update and insert records in one operation, in…
4 min
05 Jul 2026
MLflow in Databricks: traceability of Machine Learning experiments
MLflow automatically logs parameters, metrics and artifacts of every ML run. Learn to structure experiments and deploy …
2 min
13 Mar 2026
Databricks Workflows: end-to-end data pipeline orchestration
Databricks Workflows replace external orchestration tools for Spark pipelines. Learn to create multi-task jobs with dep…
2 min
20 Oct 2025
Optimized PySpark: partitioning, caching and tuning for performance
PySpark code that works in development can be disastrous in production. Learn partitioning, caching and configuration t…
2 min
27 May 2025
Unity Catalog in Databricks: unified governance for data and AI
Unity Catalog centralizes permission management, lineage and auditing for all tables, files and ML models in Databricks…
2 min
01 Jan 2025
Delta Lake in Databricks: ACID transactions for data at scale
Delta Lake turns a simple Data Lake into a transactional system with ACID, time travel and schema enforcement. Learn th…
2 min
08 Aug 2024