Best practices
Find guidance for the decisions you make when you build, govern, and operate Azure Databricks. Start with the Well-Architected Framework for a platform review, or choose a focused guide below.
The framework#
Start with the seven pillars, then the community view across all of them.
- Databricks well-architected framework: Review an Azure Databricks platform against the seven architecture pillars.
- Community best practices: Find vendor and practitioner guidance across architecture, governance, security, and cost.
Browse the Databricks platform architecture topic (10 pages).
Data and AI governance#
Unify data and AI management and security, and set data quality standards.
- Unity Catalog grants: Understand privilege inheritance, discovery, and Terraform grant ownership.
- PII and ABAC governance: Plan sensitive-data controls with governed tags, masks, row filters, and groups.
- AI and ML platform: Govern and operate model tracking, serving, evaluation, and AI workloads.
Browse the Governance and Unity Catalog topic (6 pages).
Interoperability and usability#
Integration standards, open formats, and simple paths to new use cases.
- SQL and BI: Plan SQL warehouses, dashboards, Genie, BI access, and cost controls.
- Databricks Agent Skills: Install and use Databricks Agent Skills with Claude Code, Codex, and OpenCode.
Browse the SQL and BI topic (2 pages).
Operational excellence#
Build and release processes, automated deployments, capacity, and monitoring.
- Platform lessons: Compare architecture, networking, compute, and operating decisions from platform delivery.
- Terraform vs DABs: Separate shared infrastructure from application delivery with Terraform and bundles.
- Lakeflow data engineering: Plan ingestion, pipelines, orchestration, replay, and production ownership.
Browse the Operations and reliability topic (6 pages).
Security, compliance, and privacy#
Least-privilege identity, data protection, network controls, and compliance.
- Identity with Entra ID and SCIM: Choose an account identity and group provisioning approach with Entra ID and SCIM.
Browse the Security and networking topic (3 pages).
Reliability#
Design for failure, data quality, autoscaling, and tested recovery.
No dedicated guide yet.
Browse the Operations and reliability topic (6 pages).
Performance efficiency#
Scaling, serverless, workload design, and performance testing.
- Delta and storage: Choose table layouts, optimization, retention, and VACUUM safeguards.
Browse the Compute topic (2 pages).
Cost optimization#
Optimal resources, dynamic allocation, and cost monitoring.
No dedicated guide yet.
Browse the Cost and FinOps topic (5 pages).
More ways to browse#
- Migration guides cover assessment, conversion, validation, and cutover.
- Browse topics to find related guidance and sources across the wiki.
- Product updates collect release notes and vendor and community sources.