DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Polars 2.0 Will Silently Reorder Your Rows: What to Check Before You Upgrade

Polars 2.0 Will Silently Reorder Your Rows: What to Check Before You Upgrade

Comments
8 min read
The Junior Data Engineer Job Is Gone. AI Took It.

The Junior Data Engineer Job Is Gone. AI Took It.

Comments
7 min read
Building an E-Commerce Web Data Pipeline That Does Not Lie to You

Building an E-Commerce Web Data Pipeline That Does Not Lie to You

Comments
4 min read
How to run generative AI on SQL tables with Snowflake Cortex

How to run generative AI on SQL tables with Snowflake Cortex

Comments
5 min read
Migrate Azure Data Factory to Fabric in 2026 (what the built-in tool actually does)

Migrate Azure Data Factory to Fabric in 2026 (what the built-in tool actually does)

Comments
7 min read
Understanding Apache Airflow 3.3: Key Improvements, Features Every Data Engineer Should Know, and Real-World Use Cases

Understanding Apache Airflow 3.3: Key Improvements, Features Every Data Engineer Should Know, and Real-World Use Cases

Comments
11 min read
Data Engineering Dropped DSA. What Replaced It Is Worse.

Data Engineering Dropped DSA. What Replaced It Is Worse.

Comments
7 min read
Parsing financial PDFs without chasing 100% accuracy

Parsing financial PDFs without chasing 100% accuracy

3
Comments
4 min read
Synthetic Time Series Data: A Practical Guide META

Synthetic Time Series Data: A Practical Guide META

Comments
6 min read
Window Functions Demystified: ROW_NUMBER vs RANK vs DENSE_RANK (Execution Internals)

Window Functions Demystified: ROW_NUMBER vs RANK vs DENSE_RANK (Execution Internals)

Comments
2 min read
CDC with Sling: When Log-Based Works and When Query-Based Is Enough

CDC with Sling: When Log-Based Works and When Query-Based Is Enough

Comments 1
8 min read
Data Pipelines Explained: Benefits, Types, and Use Cases

Data Pipelines Explained: Benefits, Types, and Use Cases

Comments
4 min read
95% of My PySpark Job Finished in 4 Minutes. The Last Task Took 40. Here's Why.

95% of My PySpark Job Finished in 4 Minutes. The Last Task Took 40. Here's Why.

Comments
5 min read
My PySpark Pipeline Was Reading the Same Table 3 Times — Here's Why

My PySpark Pipeline Was Reading the Same Table 3 Times — Here's Why

Comments
5 min read
dbt Was Not Designed for Multi-Tenant SaaS. Here's How I Made It Work.

dbt Was Not Designed for Multi-Tenant SaaS. Here's How I Made It Work.

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.