Azure Data Lake

Azure Data Lake

What is Azure Data Lake? It consists of two parts: Azure Data Lake Store (ADLS) to almost effortlessly store all your structured and unstructured (big) data and Azure Data Lake Analytics (ADLA) to easily analyse that same data with U-SQL. U-SQL is a mix of T-SQL and C# and probably easier to learn for T-SQL developers then other analytical languages such as Hive and Pig.

Besides storing big data and doing analytics, Data Lake could also be useful for traditional data warehouses. Storing data in ADLS is not very expensive, which makes it interesting to store staging files in an ADLS container and then use Polybase to move the data into an Azure Data Warehouse.

Azure Data Lake posts:

---

• Synapse snack: mount storage container in notebook (2024-12-07)
• Synapse - Creating Silver Delta Tables (2023-03-20)
• Synapse - Add existing Delta Table to Lake Database (2023-03-19)
• Streaming data Azure & Power BI - Introduction (2023-02-05)
• Create Data Lake containers and folders via DevOps (2022-11-07)
• ADF Snack - Empty file when creating new folder (2022-02-13)
• ADF Snack - Give ADF access to Data Lake via MSI (2022-02-12)
• Delta Lake support in Azure Synapse Analytics (2021-12-05)
• ADF Snack: get files of last hour (2020-12-29)
• Azure - Reuse Power BI dataflows (2019-03-29)
• Cognitive functions U-SQL: text sentiment (2018-02-14)
• Cognitive functions U-SQL: emotion, age & gender (2017-11-16)
• Cognitive functions U-SQL: image tagging (2017-11-16)
• Use PolyBase to read Data Lake in Azure SQL DW (2017-10-23)
• Azure - Continue with Azure Data Lake for Big Data (2017-08-29)
• Azure - Use Azure Data Lake for Big Data (2017-07-23)
• Azure - Understanding Stream Analytics Data Lake Store Destination (2017-02-25)