DEV Community

#bigdata

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Stream 50 million rows without OOM: Lazy chunked Query Streaming.
william_rodriguez_65a5898 profile

Stream 50 million rows without OOM: Lazy chunked Query Streaming.

#bigdata
Comments
1 min read
The Semantic Compression Problem: Engineering AI-Ready Views for Complex SQL
nikhil_ramank_152ca48266 profile

The Semantic Compression Problem: Engineering AI-Ready Views for Complex SQL

#ai #sql #bigdata #cloud
Comments 1
10 min read
From Pandas DataFrame to ClickHouse in milliseconds without SQL loops.
william_rodriguez_65a5898 profile

From Pandas DataFrame to ClickHouse in milliseconds without SQL loops.

#bigdata
Comments
1 min read
Never create 1-row ClickHouse parts again: The built-in Buffer Manager.
william_rodriguez_65a5898 profile

Never create 1-row ClickHouse parts again: The built-in Buffer Manager.

#clickhouse #python #bigdata #dataengineering
Comments
1 min read
Nunca mĂĄs crees partes de 1 fila en ClickHouse: Buffer Manager integrado.
william_rodriguez_65a5898 profile

Nunca mĂĄs crees partes de 1 fila en ClickHouse: Buffer Manager integrado.

#clickhouse #python #bigdata #spanish
Comments
1 min read
Row-by-row is the death of OLAP: High-speed bulk ingestion in ClickHouse
william_rodriguez_65a5898 profile

Row-by-row is the death of OLAP: High-speed bulk ingestion in ClickHouse

#bigdata
Comments
1 min read
Stop writing raw ClickHouse DDL: A Pydantic v2 model is enough
william_rodriguez_65a5898 profile

Stop writing raw ClickHouse DDL: A Pydantic v2 model is enough

#python #clickhouse #bigdata #opensource
Comments
1 min read
Mengenal Data Engineering: Pahlawan di Balik Layar Dunia Data - 23:08
khalifumarr profile

Mengenal Data Engineering: Pahlawan di Balik Layar Dunia Data - 23:08

#bigdata #data #dataengineering
Comments
2 min read
What a Delta table actually is: Parquet files plus a transaction log
dino_david_c5d8f55f119b7f profile

What a Delta table actually is: Parquet files plus a transaction log

#deltalake #databricks #dataengineering #bigdata
Comments
3 min read
Lakehouse vs Data Warehouse vs Data Lake: The Difference in One Picture
dino_david_c5d8f55f119b7f profile

Lakehouse vs Data Warehouse vs Data Lake: The Difference in One Picture

#dataengineering #databricks #deltalake #bigdata
Comments
2 min read
Open-source tool: Cross-database universal "field-level" data lineage analysis and visualization(Part 3 of 3)
zgl20053779 profile

Open-source tool: Cross-database universal "field-level" data lineage analysis and visualization(Part 3 of 3)

#productivity #database #bigdata #datalineage
Comments
2 min read
Open-source tool: Cross-database universal "field-level" data lineage analysis and visualization (Part 2 of 3)
zgl20053779 profile

Open-source tool: Cross-database universal "field-level" data lineage analysis and visualization (Part 2 of 3)

#sql #database #datalineage #bigdata
Comments
4 min read
Pruthivika Meets Redshift: Turning Big Data into Smart Insights ☁️📊
pruthivika_mr_d2457d08566 profile

Pruthivika Meets Redshift: Turning Big Data into Smart Insights ☁️📊

#analytics #aws #bigdata #database
Comments
5 min read
Open-source tool: Cross-database universal "field-level" data lineage analysis and visualization (Part 1 of 3)
zgl20053779 profile

Open-source tool: Cross-database universal "field-level" data lineage analysis and visualization (Part 1 of 3)

#datalineage #sql #bigdata #database
Comments
2 min read
Zero-copy columnar transfer: Apache Arrow meets ClickHouse in Python.
william_rodriguez_65a5898 profile

Zero-copy columnar transfer: Apache Arrow meets ClickHouse in Python.

#bigdata
Comments 1
1 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.