Databricks blog watch
Platform and governance posts from the Databricks blog. The newest entries appear first.
Added 2026-08-08#
- Ingest semi-structured data faster and more efficiently with Variant - Now Generally Available — Aug 03, 2026 For years, ingesting semi-structured data like JSON, XML, or CSV meant a difficult...
Added 2026-08-08#
- Simplify AI agent orchestration with Lakebase Postgres — Jul 22, 2026
- Why R&D Data Belongs in the Lakehouse - and Why Agents Need It There — Jul 21, 2026
- Navigating a Synapse Migration to Databricks — Jul 08, 2026
- From monolith to Lakebase to LTAP: rethinking the database from storage up — Jun 30, 2026
- A Decision Framework for ETL Migration to Databricks — Jun 26, 2026
- From test bench to lakehouse: how AVL modernizes measurement data analytics with Impulse — Jun 25, 2026
- Ingesting the Milky Way: Petabyte-Scale with Zerobus Ingest — Jun 11, 2026
- How the lakebase architecture stays resilient to cloud failures — May 27, 2026
- Observability for any agent, anywhere: Production-ready tracing with OpenTelemetry & Unity Catalog on Databricks — May 22, 2026
- How to Build Real-Time Fraud Detection using Spark Real-Time Mode and Lakebase — May 19, 2026
- How lakebase architecture delivers 5x faster Postgres writes — May 07, 2026
- Building with Databricks Document Intelligence and Lakeflow — Apr 16, 2026
- The next era of the open lakehouse: Apache Iceberg™ v3 in Public Preview on Databricks — Apr 09, 2026
- Announcing General Availability of Real-Time Mode for Apache Spark Structured Streaming on Databricks — Mar 19, 2026
- Building a near real-time application with Zerobus Ingest and Lakebase — Mar 06, 2026
- Announcing General Availability of Zerobus Ingest — Feb 23, 2026
- Introducing Python User-Defined Table Functions (UDTFs) in Unity Catalog — Nov 17, 2025
- Announcing the Public Preview of Zerobus Ingest — Oct 30, 2025
Added 2026-08-14#
- Databricks Network Configuration delivery to Tens of Millions of Serverless VMs — Aug 12, 2026 SummaryDatabricks' serverless platform launches tens of millions of VMs daily, and...
Added 2026-08-27#
- Choosing Data Governance Tools for Enterprise Data Governance — Aug 25, 2026 Data governance tools are software platforms that help organizations catalog, secure,...
- Data Mesh vs. Data Fabric: Key Differences and How the Lakehouse Resolves the Debate — Aug 25, 2026 Executive Verdict: Organization vs. TechnologyData mesh vs. data fabric hinges on...
- Modernizing SQL ETL in Lakehouse with Declarative Patterns — Aug 25, 2026 Databricks is bringing declarative ETL to data warehousing workflows in Lakehouse...
- Open Table Formats Explained: Iceberg vs. Delta vs. Hudi — Aug 25, 2026 Open table formats are metadata layers that sit on top of data files in object storage, adding ACID transactions...
Added 2026-08-30#
- Building for the AI Era: Lakebase, Streaming, and Lakehouse Innovations at VLDB 2026 — Aug 27, 2026 We are headed to VLDB 2026 to share multiple innovations that power the Databricks platform...
- Vertical Advantage: Transforming Industries with Lakebase and Agentic AI — Aug 27, 2026 In the first blog of this series, we looked at how Lakebase Postgres is rewriting...
- Object Storage + WAL: Lakebase Postgres for the agentic era — Aug 27, 2026 Agents that interact with a traditional OLTP database often create bottlenecks at the storage layer. New deployments...
Added 2026-08-31#
- Autoscaling Lakebase Postgres — Aug 31, 2026 Choosing a database instance size before you know the workload is an old building pattern...
Added 2026-09-05#
- Governance beyond security: knowledge, context & ontology on the lakehouse — Sep 03, 2026 Ask most organizations what data governance for AI means, and you’ll hear a security...
Added 2026-09-09#
- Build durable agents with Temporal and Lakebase — Sep 08, 2026 A personal-loan underwriting agent gathers evidence, applies policy, and may wait...
Added 2026-09-11#
- Unifying governance across engines and catalogs in the Open Lakehouse — Sep 10, 2026 In our previous posts, we showed how open table formats, open APIs and unified governance...
- Improving Lakebase Postgres compute cache — Sep 10, 2026 The disaggregated storage model of Lakebase Postgres provides a feature rich, flexible...
Added 2026-09-13#
- Unify your marketing data with Lakeflow Connect — Sep 11, 2026 This is the first post in a new series exploring how Lakeflow Connect brings fully...
Added 2026-09-15#
- Managed Postgres: What Lakebase Actually Takes Off Your Plate — Sep 14, 2026 Every Postgres vendor calls itself "managed." Few of them agree on what that word...
- Announcing On-Demand State Repartitioning for Apache Spark™ Structured Streaming on Databricks — Sep 14, 2026 Anyone running stateful Apache Spark™ Structured Streaming queries in production...
Added 2026-09-19#
- Database for AI Agents: 5 Evaluation Criteria — Sep 17, 2026 The five criteria for evaluating a database for AI agents are branch isolation, serverless...
Added 2026-09-23#
- Unity Catalog Pages: a governed home for your business knowledge in Genie Ontology — Sep 22, 2026 Every AI agent is only as good as the context it is grounded in. Ask an agent a question...
Added 2026-09-29#
- Lakebase Search: State-of-the-art full text and vector search for Postgres — Sep 28, 2026 Traditional OLTP systems weren't built for the search demands of AI agents. They...
Added 2026-10-01#
- IP Functions are Generally Available, bringing high-performance network analytics to the Lakehouse — Oct 01, 2026 IP data is warehousing dataEvery firewall, load balancer, VPN, CDN edge, DNS resolver,...
- A practical guide to cost optimization with Lakebase Postgres — Sep 30, 2026 Lakebase is a fully managed Postgres database, built for the operational realities...
- Your data, your storage, your rules: a 2026 guide to storing Unity Catalog managed tables — Sep 29, 2026 Unity catalog managed tables allow you to control the placement of your data when...
Added 2026-10-03#
- Real-Time Retail Intelligence: Building E-Commerce Recommendations with Lakebase and AI Search on Databricks — Oct 02, 2026 The opportunity: Personalization as a revenue engineEvery second a shopper spends...
- Lakebase Postgres branch-based restores for fast recovery at scale — Oct 01, 2026 In managed OLTP, restores have always been painfully slow and they get slower at...