Azure Data Lake Storage Gen2 Architecture
Data lake storage gen2 is an additional capability for big data analytics built on top of azure blob storage.
Azure data lake storage gen2 architecture. Data lake is a key part of cortana intelligence meaning that it works with azure synapse analytics power bi and data factory for a complete cloud big data and advanced analytics platform that helps you with everything from data preparation to doing interactive analytics on large scale datasets. Azure data lake storage gen1 is an enterprise wide hyper scale repository for big data analytic workloads. Azure data factory azure synapse analytics preview azure data lake storage gen2 is a set of capabilities dedicated to big data analytics built into azure blob storage it allows you to interface with your data using both file system and object storage paradigms. We recommend that you start using it today.
It combines the power of a hadoop compatible file system with integrated hierarchical namespace with the massive scale and economy of azure blob storage to help speed your transition from proof of concept to production. Azure data lake enables you to capture data of any size type and ingestion speed in one. Azure data lake storage gen2 access control list recursive update in public preview. Data lake analytics gives you power to act on.
Azure data lake storage gen2 is the world s most productive data lake. Azure data lake storage gen2 is now generally available. The diagram above shows a reference architecture for the modern data warehouse pipeline built on azure data lake storage gen2 and azure serverless components. Azure data lake storage gen2.
9 minutes to read. Azure data lake storage lifecycle management is now generally available. Azure data lake storage gen2 builds azure data lake storage gen1 capabilities file system semantics file level security and scale into azure blob storage with its low cost tiered storage high. Azure data lake storage gen2 also known as adls gen2 is a next generation data lake solution for big data analytics.
4 minutes to read 5. Built on azure blob the azure data lake storage gen2 offers capabilities like file system semantics directory file level security low cost tiered storage high availability disaster recovery and scalability. Azure data lake storage gen2. Its set of capabilities consists of the best features from azure blob storage and azure data lake.
For more information see the product page. Data from various sources lands in azure data lake storage gen2 via azure data factory and other data movement tools. Load data into azure data lake storage gen2 with azure data factory.