8 articles tagged Delta Lake.
The Delta Lake (Parquet) export option in Azure Synapse Link for Dataverse is deprecated: closed to new customers from October 2026 and removed in December 2027. This covers the exact scope of the deprecation, what remains supported, and how to choose between Synapse Link CSV output and Link to Microsoft Fabric.
Deterministic hash surrogate keys or IDENTITY columns for your dimensions? A practitioner's pros and cons across load order, idempotency, join cost, and reprocessing.
Learn how to enable and leverage Change Data Feed (CDF) with Fabric Mirroring to build true incremental data pipelines and unlock near real-time data processing capabilities.
VACUUM keeps Delta tables healthy, but it can also break Change Data Feed replay windows. This walkthrough shows exactly when incremental pipelines fail and how to design a safe Fabric pattern with guardrails and fallback recovery.
Most lakehouse pipelines are still doing one expensive thing repeatedly: reprocessing entire tables, even when only a tiny fraction of rows has changed. This post explains the CDF-driven load pattern, why it works, where it can hurt, and how to implement it safely in Microsoft Fabric.
A technical look at how Fabric Mirrored Databases replicate Azure SQL Database into OneLake, what the replication pipeline actually does, and where the limits are.
When defining identity columns in Databricks tables, two common options for automatic identity value generation are GENERATED BY DEFAULT and GENERATED ALWAYS. This article explains the differences and when to use each.
How to perform an in-place Synapse Spark pool upgrade for Synapse Link for Dataverse. Originally written for the 3.3 to 3.4 move — updated for Spark 3.5 and Delta Lake 3.0, since Spark 3.4 is now retired.