Tag: Spark

3 articles tagged Spark.

Apr 08, 2026

10 min read

VACUUM vs CDF in Microsoft Fabric: How to Protect Incremental Loads from Silent Data Loss

VACUUM keeps Delta tables healthy, but it can also break Change Data Feed replay windows. This walkthrough shows exactly when incremental pipelines fail and how to design a safe Fabric pattern with guardrails and fallback recovery.

Aug 28, 2025

3 min read

Microsoft Fabric

Run Spark SQL in Fabric Notebooks Without Attaching a Default Lakehouse

How to keep your Spark jobs portable, safe for concurrency, and easier to orchestrate by using explicit ABFSS paths instead of attaching a default Lakehouse in Microsoft Fabric.

Aug 28, 2025

2 min read

Microsoft Fabric

How to Use Concurrent Sessions in Fabric Data Pipelines

Speed up your Fabric pipelines by running notebooks in parallel — without breaking your Spark cluster. Learn how High Concurrency Mode works and how to configure session tags.