DEV Community

lnc profile picture

lnc

404 bio not found

Joined Joined on  github website
Hosting an Entire Open Lakehouse on Port 8080
lisancao profile
lnc

Hosting an Entire Open Lakehouse on Port 8080

#spark #iceberg #lakehouse #opensource
Comments
33 min read
All About Iceberg's File Format API: simplifying the engine/format interface and Parquet's multimodal future
lisancao profile
lnc

All About Iceberg's File Format API: simplifying the engine/format interface and Parquet's multimodal future

#iceberg #parquet #multimodal #lakehouse
Comments
25 min read
An Idiot's Guide to Spark Connect Clients
lisancao profile
lnc

An Idiot's Guide to Spark Connect Clients

#spark #sparkconnect #pyspark
Comments
18 min read
Spark's Modules, Seen Through Spark Connect
lisancao profile
lnc

Spark's Modules, Seen Through Spark Connect

#spark #pyspark #sparkconnect #streaming
Comments
17 min read
AUTO_CDC: Turning an event log into current state with Spark Declarative Pipelines
lisancao profile
lnc

AUTO_CDC: Turning an event log into current state with Spark Declarative Pipelines

#spark #declarativepipelines #cdc #iceberg
Comments
9 min read
Explaining the Python-JVM Boundary in Spark, and What Arrow Changed
lisancao profile
lnc

Explaining the Python-JVM Boundary in Spark, and What Arrow Changed

#spark #pyspark #arrow #history
Comments
14 min read
Most PySpark Tuning Advice Starts in the Wrong Place
lisancao profile
lnc

Most PySpark Tuning Advice Starts in the Wrong Place

#spark #pyspark #performance #arrow
Comments
11 min read
Stop Blaming Serialization for Slow Python UDFs
lisancao profile
lnc

Stop Blaming Serialization for Slow Python UDFs

#spark #pyspark #arrow #benchmarks
Comments
8 min read
How to Build an Open Lakehouse on Your Laptop
lisancao profile
lnc

How to Build an Open Lakehouse on Your Laptop

#opensource #dataengineering #architecture #infrastructure
Comments
42 min read
loading...