Portfolio reference implementation: SQL Server + SSIS legacy reporting → ADF incremental extraction → ADLS Gen2 → Databricks Auto Loader → Delta Lake Bronze/Silver/Gold → Unity Catalog governance.

This project builds an incremental data pipeline for Massachusetts Bay Transportation Authority (MBTA) Red Line predictions using Microsoft Fabric. It retrieves prediction and reference data from the ...

This seems to have come true: especially Databricks and Microsoft are developing technology on the hybrid data lakehouse architecture. The new Microsoft Fabric is a heavy investment in this. In this ...

Who needs rewrites? This metadata-powered architecture fuses AI and ETL so smoothly, it turns pipelines into self-evolving engines of insight. In the fast-evolving landscape of enterprise data ...

A notebook in Azure Synapse Analytics (a Synapse notebook) is a web interface for you to create files that contain live code, visualizations, and narrative text. Notebooks are a good place to validate ...

Microsoft Fabric is an end-to-end suite of cloud-based tools for data analytics, encompassing data movement, data storage, data engineering, data integration, data science, real-time analytics, and ...

Delta Live Tables (DLT) is the first ETL framework that uses a simple declarative approach for creating reliable data pipelines and fully manages the underlying ...

A Synapse Studio notebook is a web interface for you to create files that contain live code, visualizations, and narrative text. Notebooks are a good place to validate ideas and use quick experiments ...