DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Why CTE vs Subquery Matters More on Redshift Than Anywhere Else
maithreyan11 profile

Why CTE vs Subquery Matters More on Redshift Than Anywhere Else

#redshift #sql #dataengineering #aws
Comments
2 min read
Building Airbyte Connectors That Survive Flaky APIs: Cursor Checkpointing for Resilient Incremental Sync
mukesh_13 profile
Mukesh

Building Airbyte Connectors That Survive Flaky APIs: Cursor Checkpointing for Resilient Incremental Sync

#airbyte #dataengineering #elt #python
Comments
5 min read
Monitoring Airbyte's Postgres CDC Replication Slots Before They Take Down Your Source Database
mukesh_13 profile
Mukesh

Monitoring Airbyte's Postgres CDC Replication Slots Before They Take Down Your Source Database

#airbyte #postgres #cdc #dataengineering
Comments
5 min read
Building an Airbyte Destination Connector That Embeds and Dedupes Records Before They Hit pgvector
mukesh_13 profile
Mukesh

Building an Airbyte Destination Connector That Embeds and Dedupes Records Before They Hit pgvector

#airbyte #dataengineering #pgvector #rag
Comments
4 min read
Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys
jitendra_devabhaktuni_0f1 profile

Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys

#api #ai #datascience #dataengineering
Comments
5 min read
Databricks Lakebase: Give Your Agent a Branch, Not Your Production Database
jubinsoni profile

Databricks Lakebase: Give Your Agent a Branch, Not Your Production Database

#databricks #lakebase #ai #dataengineering
Comments
8 min read
The Most Underused Prompt in Data Engineering
raghavsharma_ profile

The Most Underused Prompt in Data Engineering

#ai #productivity #dataengineering #learning
Comments
4 min read
Confident Is Not Correct: Three Signs That Claude Is Guessing
raghavsharma_ profile

Confident Is Not Correct: Three Signs That Claude Is Guessing

#discuss #ai #dataengineering #programming
Comments
5 min read
Databricks Lakeflow Feature
digdata profile

Databricks Lakeflow Feature

#dataengineering #databricks #lakeflow
Comments
2 min read
Testing a data pipeline against the spreadsheets it replaced
olund profile

Testing a data pipeline against the spreadsheets it replaced

#dataengineering #testing #python #architecture
Comments
7 min read
Bad Retrieval Doesn't Show Up on the AI Bill. It Shows Up on the Review Queue.
fagundesv profile

Bad Retrieval Doesn't Show Up on the AI Bill. It Shows Up on the Review Queue.

#finops #datascience #dataengineering #ecommerce
Comments
3 min read
Designing a Community Skill for AWS Transform Custom: AWS Glue 5.0 Upgrade Readiness
dipayan_das profile

Designing a Community Skill for AWS Transform Custom: AWS Glue 5.0 Upgrade Readiness

#aws #opensource #dataengineering #ai
Comments
6 min read
Entry-Level Data Engineering Is Gone. Here's the Proof.
datadriven profile

Entry-Level Data Engineering Is Gone. Here's the Proof.

#dataengineering #career #beginners #python
Comments
6 min read
Choose the Reporting Grain Before You Choose the Chart
datplan profile

Choose the Reporting Grain Before You Choose the Chart

#accounting #dataengineering #businessintelligence #sql
Comments 1
3 min read
SnowLens: Free Snowflake Observability — 9 Detectors, Zero Data Egress
abin_alex_863f65bd6a1a77f profile

SnowLens: Free Snowflake Observability — 9 Detectors, Zero Data Egress

#snowflake #dataengineering #opensource #python
Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.