5,350 questions with Azure Synapse Analytics tags

Sort by: Updated
0 answers

The dedicated sql pool memory usage is constantly 95%-96% without any activity. It's running on DW300c service level. Is there a way to find out what exactly is utilizing this much memory?

The dedicated sql pool memory usage is constantly 95%-96% without any activity. It's running on DW300c service level. Is there a way to find out what exactly is utilizing this much memory? I'm trying to avoid increasing the service level without finding…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-06-05T04:58:02.76+00:00
Raj Singh 0 Reputation points
0 answers

There are not enough vcores resources available in the workspace while running the synapse dataflows

Hi Team, we are getting the below error dataflow while running in for each activity, Could you please help us to fix this **There are not enough resources available in the workspace, details: 'Your job requested 8 vcores. However, the workspace…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-04-15T11:09:50.6333333+00:00
commented 2025-06-05T04:22:37.6266667+00:00
Dileep Raj Narayan Thumula 175 Reputation points Microsoft External Staff Moderator
0 answers

I need to get the Synapse workspace Outbound IP address for my workspace

I need to get the Synapse workspace Outbound IP address for my workspace

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-06-04T08:49:36.4366667+00:00
Prabhu 60 Reputation points
commented 2025-06-05T02:51:08.6933333+00:00
Prabhu 60 Reputation points
1 answer

Azure Synapse Runtime for Apache Spark 3.5 Java Version

The recently released Azure Synapse Runtime for Apache Spark 3.5 mentions support for Java 17. However, the Github page for this runtime specifies Java version 11.0.27…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-06-03T18:34:25.3666667+00:00
Ty Gross 0 Reputation points
commented 2025-06-05T02:08:40.7333333+00:00
Smaran Thoomu 23,685 Reputation points Microsoft External Staff Moderator
0 answers

Create DB identity in synapse notebook

Hi, I want to create a Synapse notebook where can read data from Azure SQL server DB. So I need to connect the DB via jdbc and enter the user name and password like code below. Is there a way where I can store this username and password somewhere so that…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-04-24T03:06:32.7566667+00:00
Lotus88 176 Reputation points
edited a comment 2025-06-05T01:27:09.7366667+00:00
Lotus88 176 Reputation points
0 answers

Issue using linked service v 2.0 on notebook

Hi, I am accessing the DB in Synapse notebook with linked service version 1. It is working ok but when I changed to version 2, error occurs. Is there any additional setting I need to set in Notebook ? Thank you!

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-05-28T03:35:15.4666667+00:00
Lotus88 176 Reputation points
commented 2025-06-05T01:26:54.5466667+00:00
Lotus88 176 Reputation points
1 answer

Getting Error: Failed to save Arm Templates. Error: { "message": "Sorry, your input was too large to process.

We merged Pull requests which contained many changes in Synapse pipelines and then we were trying to publish the changes and generate a ARM template. Publish was successful The generation of ARM template got failed. Generating templates Failed to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-05-30T17:32:34.3266667+00:00
PATEL, SACHIN KUMAR 20 Reputation points
commented 2025-06-04T20:19:11.34+00:00
Chandra Boorla 13,285 Reputation points Microsoft External Staff Moderator
1 answer

Activating Inactive Data Explorer Database from 'Add Resources'

The Data Explorer database from the 'Add Resources' section appears to be inactive in the drop-down menu. What steps are needed to activate it?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-05-30T21:50:03.1233333+00:00
Young Won 0 Reputation points
edited a comment 2025-06-04T18:58:22.9666667+00:00
Chandra Boorla 13,285 Reputation points Microsoft External Staff Moderator
1 answer

Using filepath() in synapse

I created an extrenal table in synapse and try to use filepath function on it, but got below error: Here is my table: CREATE EXTERNAL TABLE bronze.trip_data_green_csv ( VendorID INT, lpep_pickup_datetime datetime2(7), …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-05-30T08:15:21.2033333+00:00
Haoran Bai 60 Reputation points
commented 2025-06-04T10:57:33.22+00:00
J N S S Kasyap 3,130 Reputation points Microsoft External Staff Moderator
0 answers

Not able to create an azure synaps analytics workspace in west europe

I'm trying to create an Azure Synapse Analytics workspace located in westeurope but when I try, I recieve the error: {"code":"ValidationFailed","message":"Workspace request validation failed, check error details for…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-05-30T12:05:20.93+00:00
Esther Kiel 0 Reputation points
commented 2025-06-04T09:45:30.85+00:00
Venkat Reddy Navari 1,985 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Does Synapse Dedicated SQL Pool support wildcards in the LOCATION of external tables?

Does Synapse Dedicated SQL Pool support wildcards in the LOCATION of external tables like below: CREATE EXTERNAL TABLE db_public.trip_data_green_csv ( VendorID INT, lpep_pickup_datetime datetime2(7), lpep_dropoff_datetime…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-06-03T09:28:27.06+00:00
Haoran Bai 60 Reputation points
accepted 2025-06-03T10:12:36.0933333+00:00
Haoran Bai 60 Reputation points
2 answers One of the answers was accepted by the question author.

User Name and Password for Dedicate SQL Pool

I created a dedicated sql pool in my synapse work space and try to connect to it using DBeaver, but I don't know my user name and password, I didn't remember I set them when I created the dedicated sql pool.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-06-03T05:55:04.8033333+00:00
Haoran Bai 60 Reputation points
accepted 2025-06-03T07:02:25.1966667+00:00
Haoran Bai 60 Reputation points
1 answer One of the answers was accepted by the question author.

How to find the reason behind org.apache.spark.sql.delta.DeltaErrorsBase.invalidCommittedVersion

I have a notebook that for several tables fetch a new version of the table from landing (ASDLGen2) and overwrite the existing DeltaTable (external) with the new version.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-05-30T15:48:31.62+00:00
Lindbo Josefine 20 Reputation points
commented 2025-06-03T06:41:37.35+00:00
Lindbo Josefine 20 Reputation points
1 answer

Dataverse Synapse Link to Lake Database pulling Date and Datetime fields.

Our Dynamics Dataverse is using the Synapse Data Link to move data to Azure Data Lake gen 2. We then use a Synapse Analytics Data flows to transform the data to a Lake Database parquet file. Up until last week this was working great, but recently any…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-06-02T16:30:56.75+00:00
Dax Kent 0 Reputation points
commented 2025-06-02T22:19:16.16+00:00
Dax Kent 0 Reputation points
2 answers

Logic app to retrieve the latest file from a blob folder

How can I create a logic app that retrieves the latest file from a blob folder when a Http request is received, where there are multiple files, and sends it as an attachment? Are there any specific steps or configurations required for this process?

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,556 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,172 questions
Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
3,517 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,550 questions
asked 2024-04-01T14:00:18+00:00
Aditya Singh 160 Reputation points
commented 2025-06-02T14:29:04.2166667+00:00
Lennart Bauer 0 Reputation points
0 answers

Can't ask for bigger limit for Synapse workspaces on subscription

When I try requesting a bigger limit, I'm faced with the following: So, no value is ever gonna be accepted. Also, the limit I'm told I actually have when I try creating a new workspace is 20. Couldn't open an actual support request, because it…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-05-26T21:23:03.49+00:00
João Florido 0 Reputation points
commented 2025-06-02T13:33:55.9466667+00:00
Shraddha Pore 105 Reputation points Microsoft External Staff Moderator
2 answers

Azure Synapse "Message Type Not Found" error when running stored procedure: Appears when lines of code reach certain line length

Hi, We need some technical guidance from either a Azure Synapse specialist to resolve an issue which we are unable to understand / fix despite running through the sql logic bit-by-bit, line-by-line. Any guidance or help would be much appreciated. We have…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
SQL Server Analysis Services
SQL Server Analysis Services
A Microsoft online analytical data engine used in decision support and business analytics, providing the analytical data for business reports and client applications such as Power BI, Excel, Reporting Services reports, and other data visualization tools.
1,343 questions
asked 2024-07-22T17:24:40.0233333+00:00
Michael King 0 Reputation points
answered 2025-06-02T12:56:46.32+00:00
Carter Hughes 0 Reputation points
0 answers

Unable to create a managed private endpoint in synapse (because it already exists)

If i try to create a managed endpoint in synapse i get the following error message: Failed to save AzureSynapseAnalytics695. Error: {"CorrelationId":null,"StatusCode":409,"Message":"Resource already exists:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2025-05-23T10:12:20.8733333+00:00
Roman Rietmann 0 Reputation points
commented 2025-05-30T05:58:22.9666667+00:00
SSingh-MSFT 16,281 Reputation points Moderator
3 answers One of the answers was accepted by the question author.

Random internal server errors: Cluster creation failed due to unexpected error

I keep getting this error in random pipelines I'm running. How can I retry it automatically? { "errorCode": "145", "message": "Internal Server Error in Synapse batch operation: 'Cluster creation failed due to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2023-10-18T07:53:31.8633333+00:00
Rhuan Samary Barreto 95 Reputation points
edited a comment 2025-05-29T11:54:43.09+00:00
Shans Bloye 0 Reputation points
1 answer One of the answers was accepted by the question author.

Azure Synapse: Failure happened on 'Sink' side, when copying data from ADLS2 to Cosmos database

Only for one specific dataset, copying data from ADLS2 to Cosmos database is failing. This is a consistent repro. But error details not providing any information on the reason for this issue. I see input data is working as expected. Error: {…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,350 questions
asked 2022-11-23T17:17:33.777+00:00
Rosi Reddy 21 Reputation points Microsoft Employee
commented 2025-05-27T12:50:14.95+00:00
Gorie, Maria 0 Reputation points