Category Archives: Uncategorized

We have discussed about DWUs and cDWUs in a previous post. In short, DWUs and cDWUs are basic units of measuring performance in Azure Synapse Analytics. In this post, let’s look at the various methods available in Synapse Analytics to update the DWU allocation.   Azure Portal GUI: This method is the most obvious andContinue reading “How to change the DWU allocation in Azure Synapse Analytics?”

Azure Data Factory helps users orchestrate and automate various activities within the Azure environment. One of the primary use cases for Azure Data Factory Pipelines is to build Data Flows to integrate, transform and move data. Once the Data Flows have been created, the next step is scheduling. This can be achieved through Data FactoryContinue reading “How to monitor Azure Data Factory Data Flows?”

Information Security is one of the most important and crucial aspects for any enterprise grade system software. For a cloud ecosystem, like Azure, having sturdy information security (including data security) is fundamental. Microsoft has been constantly improving the robustness of the Azure platform ever since its launch. Recently, Microsoft have released the second version ofContinue reading “Azure Security Benchmark”

Dedicated SQL Pools in Azure Synapse Analytics (Synapse SQL Pool for short) are optimized for the implementation of a more traditional Enterprise Data Warehouse.  To enable this, a Synapse SQL Pool is provisioned using a combination of resources. The three bundled resources are CPU, Memory, and IO. These bundled units are called DWUs (Data WarehousingContinue reading “DWUs and cDWUs in Azure Synapse SQL Pool”

Azure Data Factory has comprehensive data transformation and integration capabilities. For those looking for a simpler data integration experience compared to Data Factory Pipelines, Microsoft provides Mapping Data Flows which do not require writing any code. Mapping Data Flows in Azure Data Factory are a visual way to design data transformation flows. The data flowsContinue reading “Mapping Data Flows in Azure Data Factory”

Machine Learning is one of the most important techniques of data science and analytics. Azure Synapse Analytics supports various ways of implementing machine learning out-of-the-box. The basic process flow of a typical machine learning project is as follows: Understanding the business processes and rules Data acquisition and ingestion Analytical model selection and training Model deploymentContinue reading “Machine Learning features of Azure Synapse Analytics”

In the previous post, we discussed about Pipelines in Azure Synapse Analytics (Synapse Pipelines, for short). In today’s post, we are going to elaborate some of the major differences between Synapse Pipelines and Azure Data Factory Pipelines. S. No. Feature Azure Data Factory Azure Synapse Analytics 1. Using SSIS and SSIS Integration Runtime Yes NoContinue reading “Difference Between Synapse Pipelines and Azure Data Factory Pipelines”

If you are familiar with Azure Data Factory, then you must be familiar with the concept of activity orchestration through Azure Data Factory Pipelines. For a brief overview of Azure Data Factory pipelines, please have a look at this previous post. Synapse Analytics is positioned as the primary hybrid Data Warehousing and Big Data analyticsContinue reading “Pipelines in Azure Synapse Analytics”

1. Which index type should be used for increasing the performance of queries that use multiple fields? A. Range Index B. Spatial Index C. Composite Index D. None of the above 2. Which of the following is true for an Azure Stream Analytics Job in a “Degraded” state: A. The job is not processing anyContinue reading “ADE Q06: Cosmos DB, Azure Synapse Analytics and Stream Analytics Quiz”

Azure Synapse Link for Azure Cosmos DB provides seamless integration between Synapse Analytics and Cosmos DB. As we discussed in the previous post, the analytics workloads have evolved from the traditional structured data warehouse requiring ETL (Extract Transform Load) integration to a more flexible and semi-structured big data and multi format data analysis. Azure SynapseContinue reading “Azure Synapse Link for Cosmos DB”