Databricks Community watch · databricks.wiki

Platform and governance posts from the Databricks Community Technical Blog, filtered and accumulated. Community posts are practitioner guidance, not product documentation; verify product claims against the linked official docs before relying on them.

Source: Databricks Community Technical Blog.

Added 2026-09-21#

Multi-region model serving on Databricks with OpenSharing — Sep 21, 2026 How to extend a single-region model serving stack to additional regions using serverless workspaces, OpenSharing, Real-Time Serving Endpoints, and Lakebase.

Added 2026-09-19#

Tutorial: Databricks Genie for Data Engineers and Data Scientists — Sep 18, 2026 From a table to a running app: this hands-on tutorial takes you through the full data life cycle on 696 million records. You access the data through Databricks Marketplace, run EDA with Genie Code, explore it in plain English with Genie Agents, generate a…

Added 2026-09-17#

5 Ways to Enhance Databricks AI/BI Dashboard Tables with HTML — Sep 17, 2026 AI/BI dashboard tables can render HTML, not just text. Here's how to use reusable Unity Catalog functions to turn a plain table into visual, scannable, action-ready tables.

Added 2026-09-13#

Tutorial: Transform your Lakeflow Connect ad data into visual and conversational analytics — Sep 11, 2026 Learn how the Ad-Genie accelerator deploys an AI/BI dashboard and a Genie agent to harness data ingested by Lakeflow Connect’s Google Ads, Meta Ads, and TikTok Ads connectors.

Added 2026-09-11#

Actually understanding Unity Catalog Managed Tables — Sep 10, 2026 Open storage and fast queries have always pulled in opposite directions. Unity Catalog Managed Tables keep your files open in your own cloud while the platform owns the layout. Here's what you trade, and what you gain.

Added 2026-09-07#

Building Stateful Agents on Lakebase — Sep 07, 2026 See how Lakebase combines durable agent state, semantic memory, and live operational joins—so agents can resume work, recall past decisions, and ground recommendations in current data.

Added 2026-09-05#

Lakeflow Connect: Message Bus Ingestion - Now shipping your logs directly! (Beta) — Sep 04, 2026 Effortlessly ingest Kafka and RabbitMQ data into your Lakehouse with Lakeflow Connect's new fully managed streaming connectors. Scale without the maintenance.

Added 2026-09-01#

Managing Databricks Genie Agents as Code with Databricks Declarative Automation Bundles (DAB) — Sep 01, 2026 If your team is editing agent instructions directly in the Genie UI, you have no version history, no code review, and no reliable path to promote changes from dev to production. One wrong update and there's no rollback. In this post I'll show how to solve that

Added 2026-08-27#

Building an Autonomous Supply Chain Engine on Databricks — Aug 25, 2026 Supply chains are about to face a new kind of customer: the AI agent. Gartner predicts that by 2028, 90% of B2B buying will be AI-agent intermediated with over $15 trillion of spend flowing through agent-to-agent exchanges. When a shopping agent expects a pric
Identity Columns Best Practices for Databricks Lakehouse — Aug 18, 2026 Every data warehouse eventually needs surrogate keys, and for years that meant sequence objects, auto-increment columns, and a pile of ETL whose only job was handing out the next number. Databricks Lakehouse builds identity columns straight into Delta tables,
DABs Migration Guide: Terraform to the Direct Deployment Engine — Aug 18, 2026 A guide to migrate an existing Declarative Automation Bundle from the Terraform deployment engine to the direct deployment engine. It covers the standard procedure, when bundle deployment bind is required, and five behaviours that surfaced during a customer mi

Added 2026-08-18#

Triggered vs. Continuous Mode: A Deep Dive into Serverless Lakeflow Spark Declarative Pipelines — Aug 10, 2026 One pipeline woke up every five minutes. The other stayed running. Using the same e-commerce streaming workload, median end-to-end data freshness improved from 4.0 minutes to 33 seconds, while P95 latency dropped from 9.3 minutes to just 60 seconds. Those resu
How to Build, Test, and Ship SQL Pipelines on Databricks — Aug 10, 2026 Spark Declarative Pipelines (SDP) give SQL developers a first-class ETL experience. It is purpose-built for SQL, and it handles batch as well as streaming. There is now a full dev loop for SQL pipelines: you can either author in the new Databricks pipelines ed
Building a Production LangGraph Agent on Databricks - NorthStar Brand Copilot — Aug 10, 2026 We built NorthStar Brand Copilot, an AI assistant for brand managers and field-sales reps at a fictional multi-category CPG company (Snacks, Beverages, Personal Care). It's a LangGraph custom agent that routes each question to the right Databricks-native capab
Building Custom Apps on Lakehouse — Aug 07, 2026
Plug & Play: Zerobus Ingest Now Supports Apache Kafka® Compatible APIs (Beta) — Aug 07, 2026 Learn how to use your existing Apache Kafka producer clients to ingest data directly into your Delta lakehouse with new beta support for Kafka-compatible APIs.
Load Testing Databricks SQL Warehouses with JMeter — Part 3: Running and Analyzing Results — Aug 05, 2026
Load Testing Databricks SQL Warehouses with JMeter — Part 2: Concurrency and the Test Plan — Aug 05, 2026
Load Testing Databricks SQL Warehouses with JMeter — Part 1: Inputs and Configuration — Aug 05, 2026
Try the new Zerobus Rescue Column: Choose-Your-Own-Adventure Schema Management (Beta) — Jul 29, 2026 It is Friday afternoon. An upstream team ships a harmless-looking change: they add a region field to the events your service already emits, and somewhere along the way, a sensor starts reporting temperature as "72F" instead of 72. You did not write that produc
From Experiment to Prod: LakeFlow Spark Declarative Pipelines Testing Blueprint — Jul 28, 2026 Part 2 of the testing blueprint: how to test SDP pipelines end-to-end. Decouple your logic for fast unit tests, then use pytest, the Databricks SDK, and Databricks Connect to run the real pipeline against ephemeral, isolated Unity Catalog schemas, all from you
Serve Tableau Reports Directly from Databricks SQL — Jul 28, 2026 Connect Tableau to Databricks SQL to eliminate data warehouse sync pipelines, cut compute costs, and serve dashboards directly from your Lakehouse.
When Milliseconds Matter: Databricks Powers the Next Generation of Operational Workloads — Jul 27, 2026 Databricks redefined real-time data processing with Real-Time Mode (RTM) in Spark Structured Streaming, hitting sub-300ms P99 latency for mission-critical operational workloads. Lakeflow Spark Declarative Pipelines let both pro-coders and SQL/Python developers
One Pipeline, Any Destination: The ForEachBatch Sink in Spark Declarative Pipelines is now GA — Jul 24, 2026 A Spark Declarative Pipeline used to stop at the edge of the lakehouse. Streaming to a system with no first-party connector meant bolting a standalone Structured Streaming job onto the declarative one, and operating a second framework to do it. The ForEachBatc
Azure DevOps with Databricks DABs: Step-by-Step Integration Guide — Apr 16, 2026 A practical CI/CD walkthrough using Declarative Automation Bundles, Databricks Git folders, Azure DevOps service connections, staged deployment, and production approvals.