![]() |
Azure Data Factory |
What is Azure Data Factory? It is the ETL/ELT tool in Azure that can be used for the most common Data Warehouse or Data Lake load scenarios. With this, you can ingest from different types of sources and create full on-premise, Cloud and Hybrid data load scenarios. It is serverless and fully managed in the Cloud that you can scale on demand. In short it is the cloud version of Microsoft SQL Server Integration Services (SSIS). |
Azure Data Factory posts:
- Synapse and ADF Pipeline snack - Disable Activity (2023-06-28)
- Synapse snack - Increment counter variable (2023-04-05)
- Synapse snack - Get child pipeline value to parent (2023-03-05)
- Show dataset parameters in Azure Synapse Dataflow (2023-02-13)
- ADF Snack - Global parameters deployment resets Networking settings (2022-12-18)
- Skipped dependency between pipeline activities (2022-07-31)
- Break or stop ForEach loop in ADF and Synapse (2022-06-08)
- ADF Snack: Trigger every hour during office hours (2022-06-02)
- Refresh single table in PBI Dataset from within ETL (2022-05-19)
- Refresh Power BI Datasets via its name instead of Id (2022-05-08)
- Refresh Power BI Datasets with ADF or Synapse (MSI) (2022-04-30)
- Refresh Power BI Datasets with ADF or Synapse (SP) (2022-03-21)
- ADF Snack - Script Activity (2022-03-14)
- ADF Snack - Give ADF access to SQL DB via MSI (2022-02-20)
- ADF Snack - Empty file when creating new folder (2022-02-13)
- ADF Snack - Give ADF access to Data Lake via MSI (2022-02-12)
- ADF: Looping through pipelines and execute them (2021-12-01)
- ADF Release - Use parameters to enable Triggers (2021-11-21)
- ADF Release - Use script to enable certain Triggers (2021-11-18)
- ADF Release - Update Linked Service while deploying (2021-11-14)
- ADF Release - Set global params during deployment (2021-11-04)
- ADF Release - Create YAML CICD Pipeline - part 2 (2021-11-01)
- ADF Build - Create YAML CICD Pipeline - part 1 (2021-10-31)
- ADF Snack - Fail pipeline on purpose (2021-10-15)
- ADF Build - missing publish_config.json (2021-09-19)
- ADF Build - missing arm-template-parameters-definition.json (2021-09-18)
- ADF Release - ResourceGroupNotFound (2021-09-17)
- Analyze Azure Data Factory logs - part 2: queries (2021-07-05)
- Analyze Azure Data Factory logs - part 1: setup (2021-06-06)
- ADF Snack - hide activity input and output from log (2021-04-02)
- dataMinds Saturday - REST APIs in Data Factory (2021-03-06)
- Scaling Azure Analysis Services with ADF only (2021-02-13)
- Scaling Azure Dedicated SQL Pools from ADF (2021-01-11)
- Pausing and resuming Dedicated SQL Pools from ADF (2021-01-06)
- ADF Snack: get files of last hour (2020-12-29)
- ADF Snack: use stored procedure output (2020-12-27)
- Process Analysis Service with Firewall in ADF only (2020-11-14)
- ADF Snack: Adding metadata columns (2020-11-01)
- Execute pipelines from an other Data Factory Sync (2020-10-13)
- Using global parameters in Azure Data Factory (2020-09-24)
- Execute pipelines from an other Data Factory Async (2020-08-31)
- Pause and Resume Analysis Services with ADF only (2020-06-14)
- Process Analysis Service with Data Factory only (2020-06-13)
- Create and deploy a C# Azure Function (2020-06-09)
- Create and deploy a Python Azure Function (2020-05-23)
- Azure Data Factory - Use Key Vault Secret in pipeline (2020-05-01)
- Azure Data Factory - Parameters event based triggers (2020-04-30)
- Build dynamic pipelines in Azure Data Factory (2020-03-22)
- Use Azure Key Vault for Azure Data Factory (2020-02-16)
- Schedule Up/Downscale Azure SQL Database (API) (2020-02-02)
- Schedule Up/Downscale Azure SQL Database (TSQL) (2020-02-01)
- Azure Data Factory Webhook activity calls Runbook (2019-12-08)
- SendGrid - Sending emails via ADF & LogicApps (2019-12-01)
- Runbook snack: read parameters from Data Factory (2019-11-18)
- Staging with the Azure Data Factory Foreach Loop (2019-06-05)
- Azure - Incremental load using ADF Data Flows (2019-05-31)
- ADF snack: Pipeline templates (2019-02-18)
- Introducing Azure Function Activity to Data Factory (2019-01-31)
- Execute Logic Apps in Azure Data Factory (V2) (2018-06-04)
- Snack: Executing SSIS packages in Azure Logic App (2018-05-31)
- Runbook with ADF: Method not found (2018-04-27)
- Add email notification in Azure Data Factory V2 (2018-03-01)