Product watch

Azure Databricks release notes · June 2025

azure18 min read

View all azure databricks release notes

June 2025#

  • Cross-platform S3 access now available on workspaces with serverless egress control — Jun 30 · Azure · Product Cross-platform access from Azure Databricks to AWS S3 buckets is now supported in workspaces that use serverless egress control. Admins must add cross-cloud S3 locations to their network policy using the network policies API. See Create a storage credential that accesses an AWS S
  • Serverless GPU compute is in Beta — Jun 30 · Azure · Product Serverless GPU compute is now part of the Serverless compute offering. Serverless GPU compute is specialized for custom single and multi-node deep learning workloads. You can use serverless GPU compute to train and fine-tune custom models using your favorite frameworks and get st
  • Bring your own data lineage (Public Preview) — Jun 27 · Azure · Product Data lineage can now include external assets and workflows that are run outside of Azure Databricks. If have workloads that run outside of Azure Databricks (for example, first mile ETL or last mile BI), Unity Catalog lets you add external lineage metadata to augment the Azure Dat
  • Dashboard Git integration and workflow improvements — Jun 26 · Azure · AI/BI Improved diff review for dashboard files: When committing dashboard changes to Git, queries and text box content now appear across multiple lines in the diff, making changes easier to review. Multi-statement queries in Genie on dashboards: Genie on dashboards now supports multist
  • Genie API enhancements and SQL function improvements — Jun 26 · Azure · AI/BI New Genie API endpoints in Public Preview: You can now use the Genie API to list all conversations in a space, delete conversations, and delete Genie Agents (formerly Genie Spaces). See Genie in the REST API reference for details. More selective application of SQL functions in Ge
  • New Databricks JDBC Driver is open source — Jun 26 · Azure · Product The new Databricks JDBC Driver is now open source. The source code is publicly available under the Apache 2.0 license. Community contributions are welcome. See the Contribution Guidelines.
  • Deletion vectors on Spark Declarative Pipelines on Lakeflow tables now follow workspace settings — Jun 26 · Azure · Product New streaming tables and materialized views will follow the workspace settings for deletion vectors. See Auto-enable deletion vectors and Deletion vectors in Databricks.
  • File arrival triggers with file events is now generally available — Jun 25 · Azure · Product You can trigger job runs using file arrival triggers with file events on external locations, such as Amazon S3, Azure storage, or Google Cloud Storage. To benefit from this feature, the external locations must have file events enabled. File arrival triggers with file events allow
  • Use PDFs in Information Extraction and Custom LLM (Beta) — Jun 25 · Azure · Product Information Extraction and Custom LLM have a UI workflow to convert PDFs to Markdown and store the results in a table. Users can then use the resulting table as input in Information Extraction and Custom LLM. See Use PDFs for Information Extraction and Custom LLM.
  • Parse documents using ai_parse_document (Beta) — Jun 25 · Azure · Product The AI Function ai_parse_document() invokes a state-of-the-art AI model from Databricks Foundation Model APIs to extract structured content from unstructured documents. This function is available in Beta. See ai_parse_document function.
  • Databricks Runtime 17.0 is GA — Jun 24 · Azure · Product Databricks Runtime 17.0 and Databricks Runtime 17.0 ML are now generally available. See Databricks Runtime 17.0 (EoS) and Databricks Runtime 17.0 for Machine Learning (EoS).
  • OIDC federation for Databricks-to-open Delta Sharing is generally available — Jun 24 · Azure · Product Using Open ID Connect (OIDC) federation for Delta Sharing, where recipients use JSON web tokens (JWT) from their own IdP as short-lived OAuth tokens for secure, federated authentication, is generally available. See Enable Open ID Connect (OIDC) federation for OpenSharing recipien
  • Migrate Spark Declarative Pipelines on Lakeflow pipelines from legacy publishing mode — Jun 23 · Azure · Product Spark Declarative Pipelines on Lakeflow has a legacy publishing mode that only allowed publishing to a single catalog and schema. The default publishing mode enables publishing to multiple catalogs and schemas. Migration from the legacy publishing mode to the default publishing m
  • Custom rate limits for model serving endpoints — Jun 23 · Azure · Product You can now specify custom rate limits for your model serving endpoints using AI Gateway. Provide rate limits for any of the following: Endpoint: Specify the overall rate limit for all traffic passing through the endpoint, regardless of individual or user group limits. User (Defa
  • Sharing managed Iceberg tables in Delta Sharing is in Public Preview — Jun 23 · Azure · Product You can now use Delta Sharing to share managed Iceberg tables in Databricks-to-Databricks sharing and open sharing. See Add managed Iceberg tables to a share and Read shared managed Iceberg tables.
  • File upload and theme customization features — Jun 19 · Azure · AI/BI File upload to Unity Catalog from dashboards: Authors can now upload files to Unity Catalog directly from the dashboard data tab. See Create and manage dashboard datasets. Customizable dashboard theme: Authors can now customize the dashboard theme by setting custom font, backgrou
  • Genie filter editing and audit log enhancements — Jun 19 · Azure · AI/BI Editable filters in Genie: Users can now edit filter values to refine responses. For string columns that have entity matching (previously value dictionaries) enabled, Genie uses context to determine when editable filters could improve accuracy and offers them accordingly. New aud
  • Updates to the outbound control plane public IPs — Jun 18 · Azure · Upcoming Azure Databricks is updating the outbound control plane public IPs and Azure service tags for improved security and zone availability. These changes are part of a control plane update that began rolling out on May 20, 2025. If your organization uses resource firewalls to control
  • AI documentation for Unity Catalog tables and columns now uses the same model as Databricks Assistant — Jun 18 · Azure · Product AI documentation for Unity Catalog tables and table columns now uses a Databricks-hosted model: If you already use a Databricks-hosted model for Assistant, there is no change. If you turn off Partner-powered AI features, AI documentation now stays available and uses a Databricks-
  • Jobs & Pipelines in the left navigation menu — Jun 18 · Azure · Product The Jobs & Pipelines item in the left navigation is the entry point to the Databricks' unified data engineering features, Lakeflow. The Pipelines and Workflows items in the left navigation have been removed, and their functionality is now available from Jobs & Pipelines.
  • Moving streaming tables and materialized views between pipelines is in Public Preview — Jun 17 · Azure · Product Tables created by Spark Declarative Pipelines on Lakeflow in Unity Catalog ETL pipelines can be moved from one pipeline to another. See Move tables between pipelines.
  • Dashboard visualization fixes and schedule updates — Jun 12 · Azure · AI/BI Dashboard visualization fixes: Tooltip field highlighting in combo charts fix: Tooltips shown as you hover over fields in combo charts are now correctly highlighted. Table collapse icon fix: Fixed an issue where expanding and collapsing long text in table cells did not work as ex
  • Attribute-based access control (ABAC) in Unity Catalog is in Beta — Jun 12 · Azure · Product Databricks now supports attribute-based access control (ABAC) in Unity Catalog, enabling dynamic, tag-driven access policies across catalogs, schemas, and tables. ABAC uses tags and user-defined functions (UDFs) to enforce fine-grained access controls based on data attributes suc
  • Automatic liquid clustering is now GA — Jun 12 · Azure · Product Automatic liquid clustering is now generally available. You can enable automatic liquid clustering on Unity Catalog managed tables. Automatic liquid clustering intelligently selects clustering keys to optimize data layout for your queries. See Automatic liquid clustering.
  • Databricks SQL Serverless engine upgrades — Jun 11 · Azure · SQL The following engine upgrades are now rolling out globally, with availability expanding to all regions over the coming weeks. Lower latency: Dashboards, ETL jobs, and mixed workloads now run faster, with up to 25% improvement. The upgrade is automatically applied to serverless SQ
  • Lakebase, a managed PostgreSQL OLTP database, is in Public Preview — Jun 11 · Azure · Product Lakebase is an online transactional processing (OLTP) engine that is fully integrated with the Databricks Data + AI Platform. You can create a database instance, a new compute type, which provides dedicated, PostgreSQL-compatible storage and compute, enabling you to run transacti
  • Monitor and revoke personal access tokens in your account (GA) — Jun 11 · Azure · Product The token report page enables account admins to monitor and revoke personal access tokens (PATs) in the account console. Databricks recommends you use OAuth access tokens instead of PATs for greater security and convenience. See Monitor and revoke personal access tokens in the ac
  • Microsoft SharePoint connector (Beta) — Jun 11 · Azure · Product The fully-managed Microsoft SharePoint connector in Lakeflow Connect allows you to ingest data from SharePoint into Azure Databricks. See Overview of SharePoint ingestion setup. The Beta release supports API-based pipeline creation. UI-based pipeline creation is not yet supported
  • AI Gateway is now generally available — Jun 11 · Azure · Product Mosaic AI Gateway is now generally available. AI Gateway is a centralized service that streamlines the usage and management of AI models within an organization. AI Gateway brings governance, monitoring, and production readiness to model serving endpoints using the following featu
  • AUTO CDC APIs replace APPLY CHANGES — Jun 11 · Azure · Product The new AUTO CDC APIs create flows that support change data feeds (CDF) in Spark Declarative Pipelines on Lakeflow. Databricks recommends replacing usage of APPLY CHANGES APIs with AUTO CDC. For information about the SQL AUTO CDC API, see: AUTO CDC INTO (pipelines) For informatio
  • Databricks Jobs is now Lakeflow Jobs — Jun 11 · Azure · Product The product known as Databricks Jobs is now Lakeflow Jobs. No migration is required to use Lakeflow Jobs. See Lakeflow Jobs.
  • DLT is now Spark Declarative Pipelines on Lakeflow — Jun 11 · Azure · Product The product known as DLT is now Spark Declarative Pipelines on Lakeflow. No migration is required to use Spark Declarative Pipelines on Lakeflow. See Spark Declarative Pipelines.
  • Managed Apache Iceberg tables are in Public Preview — Jun 11 · Azure · Product Managed Apache Iceberg tables are now in Public Preview. You can read from and write to these tables from Azure Databricks or from external Iceberg engines using the Iceberg REST Catalog API. These tables are integrated with predictive optimization to apply advanced optimizations
  • Foreign Apache Iceberg tables are in Public Preview — Jun 11 · Azure · Product Foreign Apache Iceberg tables are now in Public Preview. You can read Iceberg tables managed by foreign catalogs, such as HMS, Glue, and Snowflake Horizon Catalog, using Lakehouse Federation. These tables support Unity Catalog advanced features such as fine-grained access control
  • Convert to Unity Catalog managed table from external table is in Public Preview — Jun 11 · Azure · Product ALTER TABLE... SET MANAGED is now available in Public Preview for participating customers. This command enables seamless conversion of Unity Catalog external tables to managed tables. It allows you to take full advantage of Unity Catalog managed table features, such as enhanced g
  • MLflow 3.0 is generally available — Jun 10 · Azure · Product MLflow 3.0 is now generally available. MLflow 3.0 on Azure Databricks delivers state-of-the-art experiment tracking, observability, and performance evaluation for machine learning models, AI applications, and agents on the Databricks Lakehouse. See Get started with MLflow 3 for m
  • Deployment jobs (Public Preview) — Jun 10 · Azure · Product Deployment jobs are now available in Public Preview. Deployment jobs allow you to automate tasks like evaluation, approval, and deployment whenever a new model version is created, integrating seamlessly with Unity Catalog models and Lakeflow Jobs. See MLflow 3 deployment jobs.
  • Serverless performance targets is now GA — Jun 10 · Azure · Product Selecting the serverless performance setting for jobs and pipelines is now generally available. When the Performance optimized setting is enabled, your workload is optimized for faster startup and execution time. When disabled, the serverless workload runs on standard performance
  • Model Context Protocol (MCP) for AI agents is in Beta — Jun 10 · Azure · Product Databricks now supports MCP, an open standard that lets AI agents securely access tools, resources, prompt, and other contextual information using a consistent interface. Managed MCP servers: Use Databricks-hosted servers for easy, no-maintenance access to Unity Catalog data and
  • Cross-platform view sharing is now GA — Jun 09 · Azure · Product Cross-platform view sharing via Delta Sharing is now generally available. The data access and billing method when sharing views are updated. See How do I incur and check OpenSharing costs?. A new system table allows you to track the shared materialized data history. See OpenShari
  • Azure Databricks connector in Microsoft Power Platform is in Public Preview — Jun 09 · Azure · Product Use Azure Databricks data to build canvas apps in Power Apps, flows in Power Automate, and agents in Copilot Studio by creating an Azure Databricks connection in Power Platform. See Azure Databricks and Microsoft Power Platform integration.
  • Manage network policies for serverless egress control (Generally Available) — Jun 09 · Azure · Product You can configure and enforce outbound network policies for serverless compute resources, including SQL warehouses and model serving endpoints. With network policies you can: Configure outbound access for serverless workloads. Allowlist specific domains and storage accounts for r
  • Tag policies is in Beta — Jun 09 · Azure · Product Tag policies enables admins to enforce consistent tagging across data assets such as catalogs, schemas, and tables. Tag policies define allowed tag keys and values, and control which users and groups can assign them. This enables standardized metadata management for data classifi
  • Databricks Apps support for compliance security profile standards — Jun 06 · Azure · Product Databricks Apps now supports all compliance security profile standards supported by Azure Databricks, such as HIPAA, PCI-DSS, and FedRAMP Moderate. For a full list of supported compliance standards, see Compliance security profile.
  • Consumer access entitlement is generally available — Jun 05 · Azure · AI/BI New consumer entitlement is generally available: Workspace admins can now grant consumer access as an entitlement to users, service principals, and groups. Consumer access enables limited workspace UI access, querying SQL warehouses using BI tools, and viewing dashboards with emb
  • Dashboard scheduling and filtering improvements — Jun 05 · Azure · AI/BI Dashboard schedule fix: Resolved an issue where schedules for dashboards published with global filters were not executing. Cross-filtering fix for histograms: Fixed an issue where cross-filtering with histograms did not work on large datasets.
  • Genie entity matching and SQL editor improvements — Jun 05 · Azure · AI/BI More entity matching in Genie: Genie can now support up to 60 entity matching (previously value dictionary) columns. See Tune Genie Agent quality. Genie Agent (formerly Genie Space) SQL editor fix: Resolved an issued that caused the SQL editor in a chat window disappear if the us
  • User interface updates — Jun 05 · Azure · SQL Query insights improvements: Visiting the Query History page now emits the listHistoryQueries event. Opening a query profile now emits the getHistoryQuery event.
  • New consumer entitlement is generally available — Jun 05 · Azure · Product Workspace admins can now grant consumer access as an entitlement to users, service principals, and groups. This allows for more fine-grained control over what users can do in a Azure Databricks workspace. Key details: Consumer access enables limited workspace UI access, querying
  • Salesforce Data Cloud File Sharing connector (Public Preview) — Jun 04 · Azure · Product The Salesforce Data Cloud File Sharing connector offers an alternative zero-copy solution for querying Salesforce Data Cloud. When you use file federation instead of query federation, Databricks calls Salesforce Data-as-a-Service (DaaS) APIs to read data in the underlying cloud o
  • Azure Private Link from serverless compute to resources in your virtual network (VNet) via a standard load balancer (SLB) Public Preview — Jun 04 · Azure · Product You can now enable Azure Private Link to resources in your virtual network (VNet) via a standard load balancer (SLB) from serverless compute. See Configure private connectivity to resources in your VNet.
  • Corrected job_name values in system.billing.usage — Jun 03 · Azure · Product The usage_metadata.job_name value in the system.billing.usage table now correctly contains job names. Previously, this value was populated with task keys instead of the user-provided job names. This change does not apply to one-time job runs, which continue to be logged with the
  • Mosaic AI Vector Search storage-optimized endpoints are Public Preview — Jun 03 · Azure · Product Mosaic AI Vector Search now offers the option of storage-optimized endpoints. Storage-optimized endpoints have a larger capacity (over one billion vectors at dimension 768) and provide 10-20x faster indexing. Pricing is optimized for the larger number of vectors. For details, see
  • History sharing now enabled by default to improve table read performance for Azure Databricks-to-Azure Databricks Delta Sharing (GA) — Jun 03 · Azure · Product History sharing is enabled by default (for Databricks Runtime 16.2 and above) to improve table read performance for Azure Databricks-to-Azure Databricks Delta Sharing. See Improve table read performance with history sharing.
  • Unity Catalog HTTP connections support OAuth User-to-Machine Per User credentials (Public Preview) — Jun 02 · Azure · Product Individual users can now use their own OAuth credentials to sign into external services when using a Unity Catalog HTTP connection. Previously, the only OAuth option was to share a single OAuth credential for the connection regardless of the user. See Connect to external HTTP ser
  • The sourceIpAddress field in audit logs will no longer include a port number — Jun 01 · Azure · Upcoming Due to a bug, certain authorization and authentication audit logs include a port number in addition to the IP in the sourceIPAddress field (for example, "sourceIPAddress":"10.2.91.100:0"). The port number, which is logged as 0, does not provide any real value and is inconsistent