DEV Community

loading...

Discussion on: Hacking into Pastebin scalable architecture - System Design

Collapse
entrptaher profile image
Md. Abu Taher 👨‍💻

12PB. Too much data, how much is that in compressed format?

It's not too much after 10 years though, since it's not like you guys are not gonna do anything in those 10 years after first development. 😁

Collapse
mayankjoshi profile image
mayank joshi Author

You are correct, lots and lots of work will be done in 10 years, but here we are assuming that even if we don't make any update for 10 years, the service will work perfectly fine.

How much is that in a compressed format? See it will depend on the compression algorithm we are using. Also, we are not going to store the data in compressed format, because it will again add an overhead of compressing and decompressing the data thus decreased performance.