Monthly Archives: May 2020

Data security and privacy are very important and in some parts of the world, also mandated by law. Data security is also one of the primary concerns that discourages organizations from moving data to the cloud. ADLS Gen2 has a robust, multi-layered security model. Lets have a look at the six data security layers ofContinue reading “ADLS Gen2 Security Layers”

Just like any other storage with multiple users, Azure Blob storage must handle multiple users simultaneously. This is easy if all the concurrent users are trying to read the data, but when two or more users want to write to the Blob at the same time, this creates concurrency issues. To solve the issue ofContinue reading “Azure Blob Storage Leasing”

Serverless computing is a relatively newer development in the cloud computing space. In the normal computing scenario, program code resides either on the server or the client. Serverless computing changes this paradigm, with stateless code, i.e. code that does not require any infrastructure. Customers only have to pay for the compute resources used by theContinue reading “Serverless Database Computing: Azure Cosmos DB Triggers and Azure Functions”

Azure Cosmos DB supports several storage models and various ways to access the stored data, this brings us to the question, how do the customers get billed for using Cosmos DB? The answer is customers are billed based on Request Units (RUs) they consume. RUs are an abstraction of system resources (compute, memory, IO). 1Continue reading “Azure Cosmos DB Request Units”

Azure Data Explorer is a managed data analytics service that enables users to store and process data on Azure. Let’s have a look at the main differences between Azure Data Explorer and Azure Storage Explorer: Azure Data Explorer Azure Storage Explorer Managed Service On-prem application Accessible through browser Installation required Works with Cosmos DB WorksContinue reading “Difference between Azure Data Explorer and Azure Storage Explorer”

Azure Storage Explorer is a versatile standalone application for managing Azure Storage from any platform. Azure Storage Explorer is available for Windows, Mac OS and Linux. It can be downloaded from Microsoft. Azure Storage Explorer provides access to multiple Azure data stores such as, Cosmos DB, ADLS Gen2, Queues, Tables, Blobs etc.  It provides anContinue reading “Azure Storage Explorer”

Azure Databricks is the Azure implementation of Apache Spark. Apache Spark is an open source big data processing platform. Azure Databricks was developed in consultation with the developer of Apache Spark, M. Zaharia, who later became the founder of a company named Databricks. Databricks sits in the data preparation or processing stage in the dataContinue reading “Azure Databricks”

Azure Data Factory is a code-free ETL and data integration service that enables users to create data pipelines and workflows to ingest, transform and transport data at scale. Azure Data Factory can also be used to automate various maintenance tasks such as partitioning. Azure Data Factory is based on the on-prem ETL tool that comesContinue reading “Azure Data Factory”

There are various tools to transfer data within Azure. One of the simplest ones is the AzCopy Command line utility. AzCopy can be used to copy blobs or files to or from a storage account. It can also be used to move files between different containers within the same storage account. AzCopy is a freeContinue reading “AzCopy Utility”

Azure Blob storage is a solution for storing massive amounts of unstructured data on Azure. Blob storage offers three types of resources to organize user data. Storage Accounts: Storage accounts provide unique namespace for user’s data in azure. Anything stored in Azure account will be accessed using this namespace. This is the equivalent of aContinue reading “Azure Blob Storage: Resources and Types”