DEV Community

loading...

# etl

👋 Sign in for the ability sort posts by top and latest.
ETL com Apache Airflow, Web Scraping, AWS S3, Apache Spark e Redshift | Parte 1

ETL com Apache Airflow, Web Scraping, AWS S3, Apache Spark e Redshift | Parte 1

Reactions 6
7 min read
First Look: AWS Glue DataBrew

First Look: AWS Glue DataBrew

Reactions 4
7 min read
ETL & Enterprise Level Practices

ETL & Enterprise Level Practices

Reactions 5
7 min read
Completing the #CloudGuruChallenge – Event-Driven Python on AWS from ACloudGuru

Completing the #CloudGuruChallenge – Event-Driven Python on AWS from ACloudGuru

Reactions 2
3 min read
Cut data warehouse costs with run caching

Cut data warehouse costs with run caching

Reactions 5
3 min read
Dagster with User Code Deployments (gRPC)

Dagster with User Code Deployments (gRPC)

Reactions 8 Comments 1
6 min read
#CloudGuruChallenge – Event-Driven Python on AWS - Completed!

#CloudGuruChallenge – Event-Driven Python on AWS - Completed!

Reactions 5
4 min read
Luigi for data pipelines - things I like.

Luigi for data pipelines - things I like.

Reactions 6
3 min read
Streaming data into Kafka S01/E03 - Loading JSON file

Streaming data into Kafka S01/E03 - Loading JSON file

Reactions 7
9 min read
4 lessons before starting your cloud migration

4 lessons before starting your cloud migration

Reactions 2
11 min read
How To Run Airflow on Windows (with Docker)

How To Run Airflow on Windows (with Docker)

Reactions 9 Comments 1
8 min read
10 Key skills, to help you become a data engineer

10 Key skills, to help you become a data engineer

Reactions 9
3 min read
Neo4j & NiFi – Getting NiFi Running

Neo4j & NiFi – Getting NiFi Running

Reactions 2
4 min read
Azure: Passing status messages and results back from Databricks to ADF

Azure: Passing status messages and results back from Databricks to ADF

Reactions 6
2 min read
Kafka Connect: How it let us down?

Kafka Connect: How it let us down?

Reactions 5 Comments 1
5 min read
Reinventing SSIS scripting with JavaScript - COZYROC

Reinventing SSIS scripting with JavaScript - COZYROC

Reactions 8
1 min read
ON the evolution of Data Engineering

ON the evolution of Data Engineering

Reactions 14
4 min read
Manage Data Pipelines with Apache Airflow

Manage Data Pipelines with Apache Airflow

Reactions 62
13 min read
Parallelising ETL workflows with the Jongleur gem

Parallelising ETL workflows with the Jongleur gem

Reactions 7
7 min read
CI/CD for ETL/ELT pipelines

CI/CD for ETL/ELT pipelines

Reactions 18
3 min read
CD-Stream:CDC Replicator Tool

CD-Stream:CDC Replicator Tool

Reactions 4
3 min read
How to convert xlsb to csv

How to convert xlsb to csv

Reactions 6
3 min read
Neo4j – SSIS – Connection Manager Love

Neo4j – SSIS – Connection Manager Love

Reactions 4
1 min read
Dynamic ETL from RDS to Redshift using AWS Glue

Dynamic ETL from RDS to Redshift using AWS Glue

Reactions 4
3 min read
A Jitterbit Case Study: Higher Education Adventures in Salesforce

A Jitterbit Case Study: Higher Education Adventures in Salesforce

Reactions 5
9 min read
Solved: 2 Salesforce ETL Errors

Solved: 2 Salesforce ETL Errors

Reactions 6
2 min read
Clearing A Jitterbit FillDataElements Error

Clearing A Jitterbit FillDataElements Error

Reactions 7
2 min read
S’occuper d’une erreur FillDataElements en Jitterbit

S’occuper d’une erreur FillDataElements en Jitterbit

Reactions 4
2 min read
Better Salesforce Insert/Update Operations with Jitterbit Caching

Better Salesforce Insert/Update Operations with Jitterbit Caching

Reactions 6
14 min read
Build Maintainable And Testable Data Applications With Dagster - Episode 104

Build Maintainable And Testable Data Applications With Dagster - Episode 104

Reactions 4
1 min read
How I started learning Apache Spark

How I started learning Apache Spark

Reactions 3
1 min read
Becoming Familiar with Apache Kafka and Message Queues

Becoming Familiar with Apache Kafka and Message Queues

Reactions 16
6 min read
A microservice making electorate info more accessible

A microservice making electorate info more accessible

Reactions 7
1 min read
Sending Structured Messages to Azure Event Hubs

Sending Structured Messages to Azure Event Hubs

Reactions 6
2 min read
Data Ingestion with Azure Event Hubs using Python

Data Ingestion with Azure Event Hubs using Python

Reactions 6
2 min read
Tips for Writing an ETL Console Application in C# .NET Core

Tips for Writing an ETL Console Application in C# .NET Core

Reactions 8
5 min read
Reducing the Need for ETL with MongoDB Charts

Reducing the Need for ETL with MongoDB Charts

Reactions 4
8 min read
PostgreSQL or MySQL data import into Google BigQuery

PostgreSQL or MySQL data import into Google BigQuery

Reactions 12 Comments 1
4 min read
My Thoughts on ETL and ETL testing

My Thoughts on ETL and ETL testing

Reactions 16
3 min read
What is Data Enrichment

What is Data Enrichment

Reactions 22
5 min read
Which language(s) would you recommend to Transform a large volume of data?

Which language(s) would you recommend to Transform a large volume of data?

Reactions 8 Comments 6
1 min read
Embulk open-source bulk data loader documents.

Embulk open-source bulk data loader documents.

Reactions 12
2 min read
etl for newbies...

etl for newbies...

Reactions 2
1 min read
loading...