[ot1138]

Phenomenal article, very entertaining and aligns with my experience as a prominent search "outsider" (I founded the first search intelligence service back in 2004, which was later acquired by WPP. Do I have some stories).

The engineers at Google were wonderful to work with up to 2010. It was like a switch flipped mid-2011 and they became actively hostile to any third party efforts to monitor what they were doing. To put it another way, this would like NBC trying to sue Nielsen from gathering ratings data. Absurd.

Fortunately, the roadblocks thrown up against us were half-hearted ones and easily circumvented. Nevertheless, I had learned an important lesson about placing reliance for one's life work on a faceless mega tech corporation.

It was not soon after when Google eliminated "Don't Be Evil" from the mission statement. At least they were somewhat self aware, I suppose.

[ChuckMcM]

I'm really glad the article came out though, it fills in some gaps that I was fairly confident about but didn't have anything other than my sense of the players and their actions to back up what I thought was going on.

I and a number of other people left in 2010. I went on to work at Blekko which was trying to 'fix' search using a mix of curation and ranking.

When I left, this problem of CPC's (the amount Google got per ad click in search) was going down (I believe mostly because of click fraud and advertisers losing faith in Google's metrics). While they were reporting it in their financial results, I had made a little spreadsheet[1] from their quarterly reports and you can see things tanking.

I've written here and elsewhere about it, and watched from the outside post 2010 and when people were saying "Google is going to steam roll everyone" I was saying, "I don't think so, I think unless they change they are dead already." There are lots of systemic reasons inside Google why it was hard for them to change and many of their processes reinforced the bad side of things rather than the good side. The question for me has always been "Will they pull their head out in time to recover?" recognizing that to do that they would have to be a lot more honest internally about their actions than they were when I was there. I was also way more pessimistic, figuring that they would be having company wide layoffs by 2015 to 2017 but they pushed that out by 5 years.

I remember pointing out to an engineering director in 2008 that Google was living in the dead husk of SGI[2] which caused them to laugh. They re-assured me that Google was here to stay. I pointed out that Wei Ting told me the same thing about SGI when they were building the campus. (SGI tried to recruit me from Sun which had a campus just down the road from where Google is currently.)

[1] https://docs.google.com/spreadsheets/d/18_y-Zyhx-5a1_kcW-x7p...

[2] Silicon Graphics -- https://www.sfchronicle.com/news/article/peninsula-high-tech...

[iamthirsty]

> I was also way more pessimistic, figuring that they would be having company wide layoffs by 2015 to 2017 but they pushed that out by 5 years.

Well in 2011 Google had just over 30k employees, and now they're doing "layoffs" with 180k+ in 2024. I don't think the layoffs mean much.

[bane]

ChuckMcM, I just wanted to say, I really appreciate the long view you bring to HN discussions. When you've been in tech for a few decades you start to see predictable patterns. History may not repeat, but it often rhymes.

[bbor]

A) I think it’s important to acknowledge that in many ways Google is actively trying to keep CPC low - what they care most about is total spend. A low CPC means an effective advertising network where interested consumers are efficiently targeted. Their position is complex thanks to their monopoly status over online advertising.

B) I don’t think it’s fair to characterize recent layoffs as some put-off collapse… criticize Google all you want for running a bad search engine, but right now they’re still dominant and search is the most effective advertising known to man. They’re raking in buckets of money: they had 54K employees on 01/01/2015, and 182K on 01/01/2024. Similarly, they made 66B in 2014, and 305B in 2023. The latest layoffs are them cleaning house and scaring their workers into compliance, not the death throes of a company in trouble — they’re barely a dent in the exponential graphs: https://www.macrotrends.net/stocks/charts/GOOG/alphabet/numb...

[maxerickson]

What is definition of dead? 15 years later they have huge majority of traffic share and lots of revenue.

[arromatic]

How did the slashtag feature worked and what did it do ? It seems like a interesting concept but sadly the site is dead . What happened to it ?

[greg_V]

The 2010-2013 timeline was also when the problem of ad fraud exploded. Google even acquired a company (or multiple, if I recon correctly: https://www.ft.com/content/352c7d8e-9acc-11e3-946b-00144feab... ). You had these companies popping up left and right that were snooping on Google and the emerging programmatic advertising environment to see if the websites and the traffic delivered were legit, and there were some scary numbers flying around.

The whole problem kind of got swept under the rug with most advertising ecosystems implementing a checkbox solution for clean traffic, and the web turned mobile user first.

My impression is that ad fraud never disappeared - it just got sanitized and rolled in with the other parts of the ad stack.

[specialist]

Exactly.

How much of (online) advertising is legit? Does any one know?

What would a "healthy" ad ecosystem look like? What should the the FTC (and advertisers) be working towards?

Eliminate any potential conflicts of interest? Bust up vertical integration (eg search & ads must remain separate companies)? Independent verification, as best able (eg like Nielsen does for ratings)?

Or maybe we determine (digital) ads based biz models are irredeemable, and we figure something else out.

[arromatic]

1. Do you know what caused it ? 2. How did the hostility look like ? 3. How did you circumvented them ? 4. What did your search service do ?

[ot1138]

I don't know what caused it but I suspected at the time, and still do, that it was simply business people getting more involved in order to drive growth.

The hostility was simply this. One day we had a dedicated high level Google engineer helping us out and giving us guidance (and even special tags) to get the data we needed in a cost effective manner for both Google and us. The next day, he was gone and we received demands to know exactly what we were doing, why and even sensitive information about our business. After several months of such probing, we were summarily told that the access we had was revoked and that there was no recourse.

We circumvented by setting up thousands of unique IP addresses in 50+ countries throughout the world and pointing our spiders at Google through them (same as they do to everyone else). These were throttled to maintain very low usage rates and stay off the radar. We continually refilled our queues with untouched IPs in case any were ever blacklisted (which happened occasionally).

As for what we did, we sampled ads for every keyword under the sun, aggregated and analyzed them to find out what was working and what wasn't. This even led to methods for estimating advertiser budgets. At one point, we had virtually every Google advertiser and their ongoing monthly spend, keywords and ad copy in our database. Highly valuable to smart marketers who were looking for an edge.

[ChrisMarshallNY]

I enjoy reading this chap's stuff. It's not the way that I would write, but he's got a much broader audience than I do, so he obviously is meeting the needs of the reading population.

I do feel that I can't argue with his stuff, although it is very dark and cynical (and, truth be told, I have a lot of dark and cynical, in me, as well, but I try not to let it come out to play, too often).

[underlipton]

Before 2019, the year most people who had issues with Google Search gave as the last one it was decent was 2012, so that tracks.

[ilrwbwrkhv]

How many companies have management consultants taken down? It's quite amazing how bad they are at anything. Peter Thiel's hatred for consultants is really legit.