DEV Community

Balram Prasad
Balram Prasad

Posted on

Master the Art of Azure Data Factory

Image description

Excited to share latest video series on Azure Data Factory! Learn the basics of ADF, how to debug pipelines and activities, and various techniques to copy data from different sources to different destinations. Whether you're a beginner or an experienced user, you're sure to learn something new! Check out the full playlist here

The playlist is focused on teaching various aspects of Azure Data Factory, which is a cloud-based data integration service that allows you to create, schedule and manage data pipelines. It includes videos covering the basics of Azure Data Factory, how to create data pipelines, how to debug pipelines and activities, how to do data wrangling, how to use data flows, how to create and use a self-hosted integration runtime, and how to copy data from various sources to destinations like Azure Blob Storage, Snowflake, and Azure Cosmos DB. There are also videos on how to connect Azure Data Factory with other services like Log Analytics and Azure DevOps, and how to run SSIS packages and R scripts using Azure Data Factory. The playlist covers a range of topics that will be useful for those looking to learn more about data integration in the cloud with Azure Data Factory.

Introduction to azure data factory | What is Azure Data Factory | Create Data Factory First Pipeline



Enter fullscreen mode Exit fullscreen mode

How to Debug Pipeline and Activity in Azure Data Factory



Enter fullscreen mode Exit fullscreen mode

Azure Data Factory - Incrementally load data from Azure SQL to Azure Data Lake using Watermark



Enter fullscreen mode Exit fullscreen mode

How to create and use data flow in Azure Data Factory

Azure Data factory Data wrangling | How to do Data wrangling in Azure Data Factory

Azure Data Factory - Incremental Load From SQL Managed Instance to Lake using Change data Capture

Azure Data Factory-Incrementally copy files based on LastModifiedDate by using the Copy Data tool

How to create Self-hosted Integration runtime in Azure Data Factory and Azure Synapse analytics

Copy data from a On Premise SQL Server database to Azure Blob storage using azure data factory

Azure Data Factory-Incrementally copy files based on time partitioned file name using Copy Data tool

How to use Azure Data Factory with snowflake | Copy data from Snowflake to Azure Blob using ADF

Microsoft Azure SQL Server Database to Snowflake using azure data factory in minutes



Enter fullscreen mode Exit fullscreen mode

Copy Data from Snowflake to Azure Cosmos DB using azure data factory

Load data from Azure Blob to Snowflake using Azure Data Factory



Enter fullscreen mode Exit fullscreen mode

How to Connect Azure Data Factory with Log Analytics and setup alerts

Create an Azure Data Factory, Storage ,Linked Service , Datasets , Pipeline using Bicep



Enter fullscreen mode Exit fullscreen mode

Create an Azure Data Factory, Linked Services, Datasets, Pipeline , Run and Monitor using PowerShell



Enter fullscreen mode Exit fullscreen mode

How to use Azure Data Factory with managed virtual network and private endpoints



Enter fullscreen mode Exit fullscreen mode

How to connect azure devops repo with azure data factory

Create an Azure-SSIS integration runtime in Azure Data Factory or Azure Synapse Analytics



Enter fullscreen mode Exit fullscreen mode

How to Run an SSIS package in Azure Data Factory

Run R scripts as part of a pipeline through Azure Data Factory using Azure Batch



Enter fullscreen mode Exit fullscreen mode

How to Run an Azure Databricks Notebook with Azure Data Factory

AzureDataFactory #CloudDataIntegration #DataWrangling #DataEngineering

Top comments (0)