In “ Designing a metadata-driven ETL framework with Azure ADF: An architectural perspective,” I laid the groundwork for a scalable, metadata-driven ETL framework using Azure Data Factory (ADF).

Both AWS Glue and Azure Data Factory have a user-friendly interface and offer pre-built templates and workflows. However, users who are more familiar with either the AWS or Azure ecosystem may find ...

The need for batch movement of data on a regular time schedule is a requirement for most analytics solutions, and Azure Data Factory (ADF) is the service that can be used to fulfil such a requirement.

In this blog, I will show you step-by-step of extracting nested JSON data from REST API and loading into Azure Synapse Analytics using Azure Data Factory.

In this blog, I will show you how to copy SharePoint Lists using Azure Data Factory. And to make copying multiple lists more dynamically, we created control tables along with parameters.

In this blog post, we’ll walk you through how to leverage ADF pipelines for full and incremental backups of your data lake on Azure.

In this tutorial, you create a pipeline with one activity in it: Copy Activity. The copy activity copies data from a supported data store to a supported sink data store. For a list of data stores ...

The Copy Activity performs the data movement in Azure Data Factory. It is powered by a globally available service that can copy data between various data stores in a secure, reliable, and scalable way ...