2,925 questions with Azure Databricks tags

Sort by: Updated
1 answer

Databricks workspace stuck in “Deleting” for 1 month (ApplianceBeingDeleted)

I have an Azure Databricks workspace ('yelp-databricks') stuck in "Deleting" state for over a month. All deletion attempts fail with: Code: ApplianceBeingDeleted (HTTP 409 Conflict) Tried: Azure Portal delete az databricks workspace delete az…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-18T01:14:28.7133333+00:00
Wilson 0 Reputation points
commented 2026-04-18T01:29:46.58+00:00
Manoj Kumar Boyini 12,560 Reputation points Microsoft External Staff Moderator
0 answers

Databricks node types greyed out despite DDsv5 quota in West US 2

Hi, I’m having an issue with an Azure Databricks workspace in West US 2 where many cluster node types are unavailable, even though the Azure subscription has sufficient vCPU quota. Context: Workspace region: West US 2 Workspace pricing tier: Premium…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-17T19:59:10.38+00:00
Jake Eisaguirre 0 Reputation points
commented 2026-04-17T22:27:58.03+00:00
Manoj Kumar Boyini 12,560 Reputation points Microsoft External Staff Moderator
3 answers

No Account Admin – Unable to Manage Metastore

We do not have any active Account Admin in our organization and cannot access the Databricks Account Console. As a result, we are unable to: Grant metastore-level privileges Create catalogs (CREATE CATALOG) Example error: GRANT CREATE CATALOG ON…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-16T17:51:23.47+00:00
Nitya V 230 Reputation points
commented 2026-04-17T18:53:40.9566667+00:00
Manoj Kumar Boyini 12,560 Reputation points Microsoft External Staff Moderator
1 answer

Azure Databricks workspace in resource group is stuck in Deleting.

Azure Databricks workspace adb2 in resource group adls2adb_rg is stuck in Deleting. Observed error: ApplianceBeingDeleted: The operation cannot be performed on the appliance 'adb2' because it is being deleted. What I already tried: az databricks…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-16T02:04:49.6533333+00:00
Ravi V 0 Reputation points
commented 2026-04-16T23:37:33.4666667+00:00
Manoj Kumar Boyini 12,560 Reputation points Microsoft External Staff Moderator
3 answers

Cannot access Accounts Console in Databricks – no Account Admin exists because the user no longer exists.

We have an Azure Databricks workspace that was originally created by a user who has since left the company and was removed. As a result, the Databricks account is now orphaned, and there is no active Account Admin available. Currently, no users in the…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-15T18:30:54.4666667+00:00
Felipe Gallo 0 Reputation points
commented 2026-04-16T22:53:16.07+00:00
Manoj Kumar Boyini 12,560 Reputation points Microsoft External Staff Moderator
1 answer

Databricks to Synapse Copy is taking more time after upgrading Databricks to 17.3 from 12.2

We do Copy Data from Databricks to Synapse using Databricks Notebook When we used to run in Databricks 12.2 when parallel notebooks are run, it was taking near to 1 min to 3 min for most of the notebooks, but after we upgraded to Databricks 17.3, when we…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-10T19:20:46.4433333+00:00
Immaneni, Nanda 35 Reputation points
commented 2026-04-15T21:03:40.26+00:00
Manoj Kumar Boyini 12,560 Reputation points Microsoft External Staff Moderator
0 answers

Microsoft.Databricks workspaces The DeploymentBeingDeleted error occurs when attempting to modify or deploy a resource in Azure while it is in the process of being deleted. This issue is encountered with resources such as Microsoft.Databricks workspaces,

My Azure Databricks workspace ADBNikhilProject in resource group Azure_Fundamentals is stuck in a deleting state. Issue I am unable to: Delete the Databricks workspace Delete the resource…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-12T20:16:28.2533333+00:00
Nikhil Gawate 0 Reputation points
commented 2026-04-14T20:28:54.5866667+00:00
SAI JAGADEESH KUDIPUDI 2,210 Reputation points Microsoft External Staff Moderator
1 answer

Restore Databricks Cluster

One of the team here accidently deleted a cluster can you restore it ??

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-09T15:02:53.8566667+00:00
Paul Taylor 40 Reputation points
commented 2026-04-14T09:24:57.3766667+00:00
Malika Mujahid 5 Reputation points Student Ambassador
1 answer One of the answers was accepted by the question author.

ADB Unity Catalog - Not able to select list of workspace for e.g. to share external locations

When trying to select list of workspace for sharing UC assets e.g. External Locations or Credentials, the API call to get unity catalog workspace details fails with timeout . 504 Gateway issue thus i am not able to select the specific workspace and…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-02-03T12:06:42.7+00:00
Sandesh Poudel 40 Reputation points Microsoft Employee
edited an answer 2026-04-14T08:00:32.1266667+00:00
Pilladi Padma Sai Manisha 6,740 Reputation points Microsoft External Staff Moderator
2 answers

"there was a problem with registration" - Unable to register to Azure databricks event

I'm unable to register to following event. Could you please help Technical Workshop: Implement a lakehouse with Microsoft Databricks https://msevents.microsoft.com/event?id=3674035426

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-13T16:25:54.56+00:00
PaOne 0 Reputation points
answered 2026-04-13T17:35:30.21+00:00
Smaran Thoomu 34,960 Reputation points Microsoft External Staff Moderator
1 answer

Azure Databricks cluster still cannot start after Azure for Students upgrade and payment method added

I am using Azure Databricks and cannot start my cluster even after upgrading my Azure for Students subscription and adding a payment method. Current problem: Databricks workspace: dbw-nyc311-lakehouse-central Cluster name: m10-nyc311-central-dev …

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-11T20:55:51.71+00:00
Rihua Van 0 Reputation points
edited an answer 2026-04-13T15:39:25.4766667+00:00
Smaran Thoomu 34,960 Reputation points Microsoft External Staff Moderator
2 answers

Clarification on Collection and Sub Collections Hierarchy Limits along with Root in Microsoft Purview

Hi Team, We are currently designing our governance structure in Microsoft Purview and would like to clarify the platform limitations related to collections, sub collections and hierarchy levels to ensure our architecture aligns with best practices and…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-03-04T16:44:05.07+00:00
SudhakarReddy Marepalli 40 Reputation points
commented 2026-04-10T15:48:29.5866667+00:00
Pilladi Padma Sai Manisha 6,740 Reputation points Microsoft External Staff Moderator
0 answers

Azure Databricks Deletion and creatng stuck for more than 2 hours

Title: Azure Databricks workspace stuck in "ApplianceBeingCreated" and cannot be deleted Description: I’m experiencing an issue with an Azure Databricks workspace that appears to be stuck in an inconsistent state. I started creating a…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-07T17:42:19.8533333+00:00
Guilherme Arruda 0 Reputation points
commented 2026-04-10T03:01:03.4033333+00:00
Smaran Thoomu 34,960 Reputation points Microsoft External Staff Moderator
1 answer

How to Fix Rate limit exceeded: REQUEST_LIMIT_EXCEEDED from

Ran into this error: Rate limit exceeded: REQUEST_LIMIT_EXCEEDED: Exceeded workspace input tokens per minute rate limit for databricks-claude-opus-4-6. Work with your Databricks account team to request a higher FMAPI rate limit tier.. Please retry if you…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-03T20:15:41.0366667+00:00
Andres de la Garza 0 Reputation points
answered 2026-04-08T12:02:00.36+00:00
Smaran Thoomu 34,960 Reputation points Microsoft External Staff Moderator
1 answer

Create Azure Databricks workspace

I created a workspace for Azure Databricks, which continues to show "Deployment is in progress" for more than 3 hours as I post this question. There are no alerts or errors in the activity logs. When should I expect this to complete?

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-07T17:46:10.71+00:00
Nirav Soni 0 Reputation points
commented 2026-04-08T10:00:10.7466667+00:00
Smaran Thoomu 34,960 Reputation points Microsoft External Staff Moderator
1 answer

GRPC connection issue in serverless databricks -connect

SUMMARY: Queries executed via Databricks Connect v17 (Spark Connect / gRPC) on serverless compute COMPLETE SUCCESSFULLY on the server side (Spark tasks finish, results are produced), but the Spark Connect gRPC channel FAILS TO DELIVER results back to…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-07T07:49:13.5+00:00
Subray Hegde 0 Reputation points
answered 2026-04-08T04:08:37.79+00:00
Smaran Thoomu 34,960 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Azure Databricks workspace stuck in “Deleting” for 4 days and still incurring charges

My Azure Databricks workspace has been stuck in Deleting for 4 days, and I need help. Problem I started deleting the Azure Databricks workspace from the Azure portal. The workspace has remained in Deleting state for 4 days. I can no longer launch the…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-03-16T19:37:28.6966667+00:00
Charley 20 Reputation points
accepted 2026-04-07T19:41:52.3333333+00:00
Charley 20 Reputation points
2 answers One of the answers was accepted by the question author.

Databricks Genie API returns preliminary answer, not the final one shown in Genie UI

I'm calling the Genie Spaces API (/api/2.0/genie/spaces/{space_id}/) from a custom Flask app. I start a conversation, poll the message until status: COMPLETED, then read the text attachment and query results. Problem: The API returns an…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-06T21:15:40.6333333+00:00
Abdallah Al-Zu'bi 20 Reputation points
accepted 2026-04-07T13:33:55.8566667+00:00
Abdallah Al-Zu'bi 20 Reputation points
1 answer

How to fix databricks cluster quota issue even after I increased the quota for correct compute family and in correct region.

I am unable to start my Azure Databricks cluster due to a quota error, even after increasing the required compute family quota in the correct region. Details: • Region: West Europe • VM Family: Standard_DDSv5, Standard_DDs4, Standard_Dv5 My…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-04-05T19:54:15.66+00:00
Lalit Patil 0 Reputation points
commented 2026-04-07T09:39:08.7766667+00:00
Pilladi Padma Sai Manisha 6,740 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

How to fix concurrent modification exception?

Hi, I created a watermark table in Azure Databricks to record the watermark values, which is helpful for incremental data loading. However, this watermark table will be modified concurrently, which has led to a concurrent modification error. Do you have…

Azure Databricks
Azure Databricks

An Apache Spark-based analytics platform optimized for Azure.

2,925 questions
asked 2026-03-18T07:41:53.2366667+00:00
zmsoft 695 Reputation points
accepted 2026-04-07T03:08:16.8633333+00:00
zmsoft 695 Reputation points