Monthly Archives: April 2020

Microsoft’s SQL Server has been one of the most popular relational databases for quite some time. The cloud version of SQL Server is called Azure SQL Database. Azure provides the following options to move data from existing on premises SQL Server to Azure SQL database : SQL Server Stretch Database: This option moves some ofContinue reading “Moving On-prem SQL Server to Azure”

Azure Data Lake Storage Gen2 (ADLS Gen2) and Azure Synapse Analytics (formerly, SQL Data Warehouse) both are highly scalable and have the capability to ingest and process huge amounts of data (on a Peta Byte scale). But there are some differences : ADLS Gen2 Azure Synapse Analytics  Optimized for storing and processing structed and non-structuredContinue reading “Difference between Azure Data Lake Gen2 and Synapse Analytics”

In the previous post, we learned about the various ways to store data in Azure. In this post, let’s learn about the various ways Azure provides to process, analyze and transform data. Azure Data Catalog: As the name suggests, this is a catalog or index, which lists the metadata for all data elements stored inContinue reading “Azure Data Services”

Azure Storage platform is Microsoft’s cloud storage solution. Like other cloud offerings, it is a managed service and caters to various storage requirements and scenarios. It includes the following storage options: Azure Blobs : Blob stands for binary large object. This storage solution supports all kinds of files including, text files, videos, images, documents, binaryContinue reading “Azure Storage”

Let’s start with the definition of Data Engineering. Simply put, data engineering is the process of designing, developing, maintaing and enhancing the way data is acquired, processed, stored and consumed within an organization. Data Engineering is an important skill which is quickly becoming a “must have” from a “good to have”. A data engineer isContinue reading “Responsibilities of a Data Engineer”

There are various Data Services on Azure catering to different requirements and use cases. Some of these relate to one of the existing Microsoft data products e.g. Azure SQL Server and Azure Analysis Services, while others are new services designed for big data analytics e.g. Azure Machine Learning. The strength of Azure data platform liesContinue reading “Azure Data Platform”

Azure is Microsoft’s cloud computing platform. Cloud computing is an online computing service (which may include both hardware and software) where the service provider creates a managed service to enable users to access these services on demand. So instead of “buying” hardware or software which means paying to own the product, users are “renting” theContinue reading “What is Microsoft Azure ?”