Databricks Wiki
A knowledge base for people who build, govern, and operate Databricks. The guides follow the seven pillars of the Databricks Well-Architected Framework, product updates arrive by month, and community lessons are labeled as community lessons. Examples use Azure. The framework is the same on AWS and Google Cloud.
Read the Azure Databricks release notes by month, or start with the Entra ID and SCIM guide for identity and access.
Guides#
One collection per pillar of the Databricks Well-Architected Framework. Open a guide, or see the full list.
The framework#
Start with the seven pillars, then the community view across all of them.
Data and AI governance#
Unify data and AI management and security, and set data quality standards.
Interoperability and usability#
Integration standards, open formats, and simple paths to new use cases.
Operational excellence#
Build and release processes, automated deployments, capacity, and monitoring.
Security, compliance, and privacy#
Least-privilege identity, data protection, network controls, and compliance.
Reliability#
Design for failure, data quality, autoscaling, and tested recovery.
No dedicated guide yet.
Performance efficiency#
Scaling, serverless, workload design, and performance testing.
Cost optimization#
Optimal resources, dynamic allocation, and cost monitoring.
No dedicated guide yet.
Browse by topic#
Topics are broad areas. Tags are single concepts, like Terraform or serverless, that cut across them. The number is the page count.
Migrating to Databricks?#
Moving off SQL Server or Synapse? Start with the migration overview, then the guide for your source platform.
What changed#
- Corrected access-control, identity refresh, network migration, runtime, and pipeline monitoring guidance.
- Added Lakeflow recovery procedures, serverless cost attribution, and Photon fallback diagnosis.
- Added bundle migration details, integrated SQL Server CDC, and selected September feature changes.
For product changes, read the Azure release notes by month or the full product updates list. The changelog covers changes to this wiki.
536tech maintains this wiki. A product claim gets checked against the official documentation before a page counts as reviewed. About this wiki explains how that works. The coverage report shows the gaps.