Best practices

azure2 min read

Find guidance for the decisions you make when you build, govern, and operate Azure Databricks. Start with the Well-Architected Framework for a platform review, or choose a focused guide below.

The framework#

Start with the seven pillars, then the community view across all of them.

Browse the Databricks platform architecture topic (10 pages).

Data and AI governance#

Unify data and AI management and security, and set data quality standards.

Browse the Governance and Unity Catalog topic (6 pages).

Interoperability and usability#

Integration standards, open formats, and simple paths to new use cases.

  • SQL and BI: Plan SQL warehouses, dashboards, Genie, BI access, and cost controls.
  • Databricks Agent Skills: Install and use Databricks Agent Skills with Claude Code, Codex, and OpenCode.

Browse the SQL and BI topic (2 pages).

Operational excellence#

Build and release processes, automated deployments, capacity, and monitoring.

  • Platform lessons: Compare architecture, networking, compute, and operating decisions from platform delivery.
  • Terraform vs DABs: Separate shared infrastructure from application delivery with Terraform and bundles.
  • Lakeflow data engineering: Plan ingestion, pipelines, orchestration, replay, and production ownership.

Browse the Operations and reliability topic (6 pages).

Security, compliance, and privacy#

Least-privilege identity, data protection, network controls, and compliance.

Browse the Security and networking topic (3 pages).

Reliability#

Design for failure, data quality, autoscaling, and tested recovery.

No dedicated guide yet.

Browse the Operations and reliability topic (6 pages).

Performance efficiency#

Scaling, serverless, workload design, and performance testing.

  • Delta and storage: Choose table layouts, optimization, retention, and VACUUM safeguards.

Browse the Compute topic (2 pages).

Cost optimization#

Optimal resources, dynamic allocation, and cost monitoring.

No dedicated guide yet.

Browse the Cost and FinOps topic (5 pages).

More ways to browse#