top | item 16729098 (no title) anubisresources | 8 years ago How many petabytes does something like this take up? discuss order hn newest written|8 years ago I download profiles I'm interested in of course. Not everything. 70 profiles with 75000 tweets take 5GB for JSON + images + linked pages content + 60GB for videos.I didn't optimize for space at all, twitter's json is quite wasteful. llao|8 years ago The internet says there are about 500 million tweets per day. If we assume 500 bytes for storing each, this would be 250 Gigabytes per day. written|8 years ago Average tweet JSON object size is 5300B. load replies (1)
written|8 years ago I download profiles I'm interested in of course. Not everything. 70 profiles with 75000 tweets take 5GB for JSON + images + linked pages content + 60GB for videos.I didn't optimize for space at all, twitter's json is quite wasteful.
llao|8 years ago The internet says there are about 500 million tweets per day. If we assume 500 bytes for storing each, this would be 250 Gigabytes per day. written|8 years ago Average tweet JSON object size is 5300B. load replies (1)
written|8 years ago
I didn't optimize for space at all, twitter's json is quite wasteful.
llao|8 years ago
written|8 years ago