DEV Community

Tomoya Oda profile picture

Tomoya Oda

Kaggle Expert

Location Dublin, Ireland Joined Joined on  github website
PyTorch Distributed Data Parallel (DDP) using Hugging Face Accelerate

PyTorch Distributed Data Parallel (DDP) using Hugging Face Accelerate

Comments
7 min read
Kaggle SETI 59th Solution

Kaggle SETI 59th Solution

Comments
3 min read
Kaggle Coleridge 52nd Solution

Kaggle Coleridge 52nd Solution

Comments
2 min read
Spark on AWS Glue: Performance Tuning 5 ( Using Cache)

Spark on AWS Glue: Performance Tuning 5 ( Using Cache)

Comments
2 min read
Spark on AWS Glue: Performance Tuning 4 ( Spark Join)

Spark on AWS Glue: Performance Tuning 4 ( Spark Join)

2
Comments
2 min read
Spark on AWS Glue: Performance Tuning 3 ( Impact of Partition Quantity)

Spark on AWS Glue: Performance Tuning 3 ( Impact of Partition Quantity)

Comments
2 min read
Spark on AWS Glue: Performance Tuning 2 (Glue DynamicFrame vs Spark DataFrame)

Spark on AWS Glue: Performance Tuning 2 (Glue DynamicFrame vs Spark DataFrame)

3
Comments
2 min read
Spark on AWS Glue: Performance Tuning 1 (CSV vs Parquet)

Spark on AWS Glue: Performance Tuning 1 (CSV vs Parquet)

1
Comments
4 min read
Configuring dind (docker in docker) with VSCode Remote Development

Configuring dind (docker in docker) with VSCode Remote Development

Comments
1 min read
loading...