DEV Community

Discussion on: S3 vs HDFS

luminousmen profile image
luminousmen Author

Not really - you can use whatever platform you want with s3. I think HDFS nowadays is used internally by those cloud providers or on-prem solutions.

neverchanje profile image
Wu Tao

Sure, but if you run large dataset computation on top of aws s3 without deploying on ec2, it will probably cost a big I/O bandwidth payroll.