DEV Community

loading...

Discussion on: S3 vs HDFS

Collapse
luminousmen profile image
luminousmen Author

Not really - you can use whatever platform you want with s3. I think HDFS nowadays is used internally by those cloud providers or on-prem solutions.

Collapse
neverchanje profile image
Wu Tao

Sure, but if you run large dataset computation on top of aws s3 without deploying on ec2, it will probably cost a big I/O bandwidth payroll.