DEV Community

#etl

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Same guarantees, without programming them: Hydra ETL vs Airflow + dlt + dbt vs Airflow + Airbyte + dbt
bejaouibechir profile

Same guarantees, without programming them: Hydra ETL vs Airflow + dlt + dbt vs Airflow + Airbyte + dbt

#dataengineering #python #etl #airflow
Comments
6 min read
What Is ETL Testing?
keploy profile
keploy

What Is ETL Testing?

#etl #webdev #productivity #software
Comments
14 min read
Dataflow Gen2 Eating Your Microsoft Fabric Capacity? Why Default Settings Burn 60-80% Extra CUs
costfabric profile

Dataflow Gen2 Eating Your Microsoft Fabric Capacity? Why Default Settings Burn 60-80% Extra CUs

#microsoftfabric #dataengineering #powerbi #etl
Comments
3 min read
From Google- and Meta-Like CSVs to a Trusted Schema: Building Fail-Closed Python Adapters
rupak_kulkarni_08b45c5846 profile

From Google- and Meta-Like CSVs to a Trusted Schema: Building Fail-Closed Python Adapters

#python #dataengineering #etl #testing
Comments
6 min read
What is CDC in data engineering? Change data capture explained
kateryna_kozachenko_e23f1 profile

What is CDC in data engineering? Change data capture explained

#dataengineering #database #postgres #etl
1
Comments
15 min read
Load CSV and JSON from Azure Blob into Postgres with pg_duckdb
franckpachot profile

Load CSV and JSON from Azure Blob into Postgres with pg_duckdb

#postgres #duckdb #azure #etl
Comments
6 min read
Snowflake Openflow Limitations: 6 Production Trade-offs
techsourabh profile

Snowflake Openflow Limitations: 6 Production Trade-offs

#dataengineering #database #snowflake #etl
4
Comments
15 min read
From YAML validator to event-driven projects: 14 releases of Hydra ETL in six weeks
bejaouibechir profile

From YAML validator to event-driven projects: 14 releases of Hydra ETL in six weeks

#dataengineering #python #etl #opensource
1
Comments
4 min read
Data Engineering Log 2/3: Source Systems, Data Ingestion, and Pipelines
ayush_pangaonkar profile

Data Engineering Log 2/3: Source Systems, Data Ingestion, and Pipelines

#dataengineering #aws #etl #airflow
Comments
1 min read
Grounding Palantir AIP Workflows in the Ontology: Tool Design, Guardrails, and Evaluation Patterns
kaviwrites profile

Grounding Palantir AIP Workflows in the Ontology: Tool Design, Guardrails, and Evaluation Patterns

#palantir #dataengineering #etl #datamigration
Comments
10 min read
Announcing det: - Fast, local-first SQL ETL workspace and pipeline orchestration engine
saurabhr2 profile

Announcing det: - Fast, local-first SQL ETL workspace and pipeline orchestration engine

#etl #dataengineering #sql #python
Comments
2 min read
Amazon Aurora PostgreSQL: Query Remote Data Without Building an ETL Pipeline
omayrashraf profile

Amazon Aurora PostgreSQL: Query Remote Data Without Building an ETL Pipeline

#aws #dataengineering #etl #postgres
Comments
5 min read
Airflow 3 quietly changed what your cron schedule means
itcraftsman profile

Airflow 3 quietly changed what your cron schedule means

#airflow #dataengineering #python #etl
Comments
3 min read
Replacing SSIS with a C# data flow
andreaslennartz profile

Replacing SSIS with a C# data flow

#etl #csharp #lowcode
Comments
9 min read
Migrating Legacy ETL to Palantir Foundry: Incremental Transforms, Schema Evolution, and Reconciliation Without Downtime
kaviwrites profile

Migrating Legacy ETL to Palantir Foundry: Incremental Transforms, Schema Evolution, and Reconciliation Without Downtime

#dataengineering #etl #palantir #python
Comments
9 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.