top | item 15700261

(no title)

tomkin | 8 years ago

Twitter's biggest mistake was hiring thousands of people when they only needed 30. It doesn't need thousands of people. It doesn't even need 100.

Twitter is not a technological marvel. It's something Oprah promoted, and Donald Trump bitches on.

And now, it's an API with a (social) class-based access, and without irony, also promotes itself as a leader in conversation and exchange.

discuss

order

Jagat|8 years ago

I often see these kind of comments and find them extremely myopic. Sure you can create a twitter clone all by yourself, but good luck scaling it to ~150k tweets per second writes[1]. All the while ensuring they're fanned out to all the respective followers some of whose tweets may need to be fanned out to tens of millions of users in a matter of seconds.

You'll need 30 engineers just to build and maintain the datastores, caching mechanisms, and service deployment infrastructure. You then have the actual services, real time streaming platforms, streaming applications, batch infra (hadoop), analytics pipelines, notifications, security, anti-spam, recommendation/machine learning pipelines, ads infrastructure etc to name a few. Can't find it now, but there should be a circa 2011 architecture of twitter in one of the blogs somewhere. I recommend you have a look at it.

If you're comparing it with WhatsApp, note that WhatsApp messages are mostly 1->1 and it's easier to shard the servers by recipient. Also, not having to bother persisting all the messages forever simplifies the system by a lot.

[1] https://blog.twitter.com/engineering/en_us/a/2013/new-tweets...

tomkin|8 years ago

I think you're making a few assertions that would be more honestly served if you conceded as assumptions.

Twitter validated it's own employee count with an absurd overhead.

It has concerns of scale, performance and user experience. So does GitHub, Shopify, Pandora, Spotify, Snapchat, LinkedIn, MailChimp, WordPress.com, etc, and yet, manage will much less resources and overhead. Oh yea, and fucking Netflix - which - as far as I can tell - has much more and difficult problems to solve at a much faster pace. They employ 4,700.

As of this comment, Twitter employs 3,583 people.

What they needed to do was hire 100 talented people, allow third-party clients, try and occasionally acknowledge the developers who implement their platform, and stopped with the asinine "we're trying so hard guys" blog posts. We get it. You're having a hard time and you want everyone off of your grass. That's fine, but don't come asking for sugar at my house 'cause you ain't Beyonce.

rtpg|8 years ago

100% agreed that running a network on the scale of Twitter, with all the strong interconnections, is extremely hard. Probably the hardest, moreso than even things like Facebook.

I do wonder what the thousands of engineers are doing. I imagine there's a lot of fire-fighting, but is it only that?

It could be the case that twitter is constantly falling over, still.

agentdrtran|8 years ago

How dumb do you have to be to think twitter could be run by 30 people? They probably have more than 30 account managers alone.

tomkin|8 years ago

I guess I would just point to GitHub, Shopify, Pandora, Spotify, Snapchat, LinkedIn, MailChimp, WordPress.Com, (insert everyone else basically here).

itronitron|8 years ago

and they only need account managers because they are selling advertising. They could have chosen to monetize their platform another way but lacked the creativity to do so.

stuntkite|8 years ago

At one point like 10 years ago, I left ebay because it felt like more than 60% of everything was fraud. I think they've curtailed that a bit, but that is what Twitter feels like to me now. Like 80% of the traffic has to be fraud because they killed all the real users. They have to make money off the fraud and be sort of complicit just like Paypal and eBay used to be (to a larger degree than they are now).

No one ever held Paypal and eBay responsible for what they did because it was so esoteric. It seems that there is a government investigation that is going to lead to a nice graph of botnets used for social manipulation which is cool, but I doubt we'll ever get a proper accounting of the really inventive fraud that dominates what twitter is.