data2al icon data2al Snowflake, Databricks, and SQL Engineering
Medium

Snowflake And Databricks

Practical notes for Snowflake, Databricks, and SQL.

This site is organized into three focused libraries: Snowflake platform playbooks, Databricks delivery patterns, and reusable SQL examples.

63 Published articles
32 Snowflake-focused notes
16 Databricks-focused notes

Start Here

Recently Posted

Databricks Platform Architecture A reference for how Databricks is organized: the split between control plane and data plane, Unity Catalog's 3-level namespace, the available compute types, and what Delta Lake provides at the storage layer. Deploy Databricks Projects with Declarative Automation Bundles A practical reference for Declarative Automation Bundles (DABs): project structure, environment targets, bundle commands, Git Folders, and wiring up a CI/CD pipeline with GitHub Actions. Govern Data in Unity Catalog A practical reference for Unity Catalog data governance: the difference between managed and external tables, GRANT/REVOKE/DENY privilege rules, column-level masking, row-level security with row filters, and attribute-based access control. Ingest Data into Databricks with COPY INTO, Auto Loader, and Lakeflow Connect A practical reference for the four main ways to bring data into Databricks: COPY INTO for batch loads, Auto Loader for incremental file ingestion, Lakeflow Connect for managed connectors, and JDBC for database sources. Monitor Databricks Jobs and Troubleshoot Spark Performance A practical guide to monitoring Databricks job runs, reading the Spark UI, diagnosing data skew and spill, tuning shuffle partitions, and diagnosing common cluster startup failures. Operate Delta Lake Tables with Time Travel, VACUUM, and Liquid Clustering A practical reference for Delta Lake table operations: querying history, reverting changes, purging deleted data, compacting files, and clustering for query performance.