> Brynjolfsson: ”I asked Sundar [about Google losing the initiative]. He didn't really give me a very sharp answer.
> Schmidt: Google decided that work life balance and going home early and working from home was more important than winning. The reason startups work is because the people work like hell. I'm sorry to be so blunt, but the fact of the matter is if you go found a company and compete against the other startups — like [we did] in the early days of Google — you're not going to let people work from home and only come in one day a week.”
It’s pretty cack-handed to publicly talk about your successor like that. While the WFH part of this got a lot of press I wonder if the free-wheeling side-swipe at Sundar Pichai had more to do with the cringe backpedaling.
Also, the humblebrag about his medal!… he’s an investor!… he showed Sam Altman his calculations that OpenAI will need lots of electricity!… he’s an investor!… he wrote a report setting national AI policy that was “only about 752 pages long”!… he’s an investor!
Schmidt has done some amazing things and his achievements will eclipse many others but I do wonder if even he feels a bit of the post-FAANG blues where one misses the glory days of ones peak, over performing and telling everyone about it to show you’ve still got it.
> you're not going to let people work from home and only come in one day a week
Huh, I guess I dreamed the first start-up I worked for (a couple of decades ago) where indeed I only came in one day a week.
Yes of course you "work like hell". We had a nasty leak bug and I set things up so that day or night if the leak was detected my stereo would go maximum volume and play "Straight Outta Compton". How does commuting count as "working like hell" ?
If I'm sat in a car (and once a week I often was) then I'm not working am I? I am useless for several hours each day we do that. Maybe sometimes the CTO (who is in the car, he's driving, he worked from home too) is discussing relevant technology, you know design of our secret sauce schema-less database engine, IP stuff - but then it's also possible we're discussing the album that's playing, or a video game we both enjoyed, or a novel we're both reading.
Lots of great startups have remote teams so this argument by Schmidt is pretty weak. Google is hybrid, not even remote. Also, I don't think that well motivated and engineers work or produce less while WFH. It could be the opposite. Less interruptions are key, as explained in Peopleware. But bad managers love controlling people in open plan offices.
Regardless, I found it surprising Schmidt didn't talk about other stuff that differentiates startups. Smaller teams, a lot less red tape, a lot more ownership, less politics... Google should really follow Steve Jobs 2011 advice to Page about focus. Breaking down into a conglomerate was a great idea to bring focus and agility, but it has not been fully executed and lots of the different resulting entities seem dysfunctional.
At some point, someone is going to realize that people are not going to slave away for the privilege of living in a rental and drinking meal replacement shakes because they're too busy to eat.
People who worked at Google early on were always going to get rich, people who bust ass for Google now might wake up to a 10,000 man layoff in the morning.
Eric has a penchant for saying things he thinks before thinking about how they might be heard. He famously said, "There is no privacy, get over it. If you're not doing anything wrong you don't have anything to worry about."
Imagine my complete surprise that the guy in charge of Google when sex with subordinates was rampant, and who gave an exec who was sacked for sexual harassment a ninety million dollar parachute, is upset that there aren't more people in the office.
Google did to AI what Bell did to magnetic recording: retarded it's progress for decades because they were afraid it would harm their main product.
For those that don't know:
>In early 1934, Clarence Hickman, a Bell Labs engineer, had a secret machine, about six feet tall, standing in his office. It was a device without equal in the world, decades ahead of its time. If you called and there was no answer on the phone line to which Hickman’s invention was connected, the machine would beep and a recording device would come on allowing the caller to leave a message.
>Soon after Hickman had demonstrated his invention, AT&T ordered the Labs to cease all research into magnetic storage, and Hickman’s research was suppressed and concealed for more than sixty years, coming to light only when the historian Mark Clark came across Hickman’s laboratory notebook in the Bell archives.
>AT&T firmly believed that the answering machine, and its magnetic tapes, would lead the public to abandon the telephone.
The same thing was true for google, with the very real threat that something like perplexity will eat their lunch by having a monthly payment and no adds. With google relegated to a second tier API endpoint.
20 years of AI advancements were used for better add targeting in gmail, and in the months after chatgpt came out, a better spell checker.
I took this more as Schmidt being disappointed in what Google has become. He really did build Google, its completely valid for him to be mad about the state of the company culture wise.
Really fascinating to see such a mix of blind spots, insecurity and, yet, good insights on full display here. It’s almost as if he’s a normal human being at the end of the day, despite his circumstances.
It’s almost as if what he says carries more weight due to his status and he should be more careful in what he says publicly, especially if it’s charged. He deserves the flogging he’s getting.
The biggest difference between him and a "normal smart person" is they realize they have blind spots and choose not to publicly spout opinions on them.
This thing just gets repeatedly uploaded, I guess deletion is not that useful now.
Put that aside, Eric Schmidt did told the truth (maybe except AI and NVidia stock thing) and offered the public a glace of how things actually work within the industry.
One important thing he mentioned was (after simplified) "just steal, and deal with justice later", which actually mirrors what Steve Jobs once said "Great artist steal". This should remind everyone, that if you want to have significant achievement in this industry, you at least needs to guard against thefts, because there WILL BE (maybe ALREDY are) people who comeout with a "be shameless or be dead" mindset after been educated by people like that man.
(Also, I found it quite funny that one of Eric's girl friend has probably took his lesson too)
From what I understand, it’s over the controversy in his statement about Google losing competitive advantage because they chose work life balance over in-office collaboration.
it was too truthful from what I can ascertain. Always interesting when you get to hear what someone actually thinks. Most tech talk/interviews are access / pr fluff.
- Alphabet have made a switch from a (mostly) tech-driven company to a pure finance-driven one, when this happen you can expect a bit of growth, even a sharp one for a little time, than an inexorable decline;
- the more and more centralized web means search engine became dysfunctional beasts try to pour water to specific mill instead of being open search and for a company living on search more than anything else it's a problem, of course there is GMail a project born when Google was tech-driven, but again GMail is search, so Drive, and in that "specific domain" they have substantial competitors and they can't have innovation being financially-driven now;
- LLM-push a way to reach a kind of dummy semantic holy grail of research while very popular is a substantial failure. Yes it have a certain wow-effect, but results are such low quality that the wow effect will not last longer and current "better-than-Alphabet" competitors in that field still have to see any meaningful and durable growth and profit.
Long story short the anti-remote-working is just another droplet in a substantially lost PR/élite battle to force people in the city, the sole way they have to remain alive because finance and services can only live at large city scale where they own anything and they rent/sell services to anyone. In a spread world they simply die killed by SME innovation and personal ownership that value substantial innovation against services.
IMVHO the big-tech model, a cleptocracy born out of Xerox tech once they have found a way to make it anti-user, is at it's end. I do not know what could happen next because so far ALL élites want such model to rule slaves, and we have lost much of intelligence, competence of the Xerox time, and no one else in the world seem to be there, China included, who was able to surge as an industrial power but still lag behind in software, even in the current sorry state of IT. But it's clear that the service model of big tech is dead. Or they found a way to reinvent or they are done.
It will be interesting to see if Schmidt’s comments about the future of AI being mostly a China-US game will come true, or if less powerful models will ultimately be more useful than single centralized powerful ones.
The analogy here might be between nuclear weapons and drones; the former are controlled entirely by a small number of countries, but the latter probably have more of a direct role to play in the future of warfare - and yet aren’t costly or difficult to make at all. The assumption tends to be that the most powerful well-capitalized tech always wins, but I don’t think that is necessarily the case.
This answer was responding to a question about smaller countries competing against China, the US, and larger countries in AI. “The rich” here refers to the richer countries, not people in general.
Please read/listen to the link before commenting on out of context sections.
it's funny how both threads here on hn, the top comments focus on his quote badmouthing work life balance.
when anyone with half a brain can see that work life balance has much less impact on a tech company than replacing the tech founders with the likes of him and a sea of business major middle Managers...
Eric ran Google while the Android team often worked 7 days a week in office (famously: “bacon Sundays”) and still managed to blow every advantage they had over iOS by making repeatedly terrible strategic decisions.
But yeah, he’d have won AI by keeping butts in seats…
Listened to the first few mins. Did he say anything controversial in the? The part about Google work-life balance isn't that big a deal. It's no secret that startups grind more.
"The country is going to have to learn critical thinking. That may be an impossible challenge for the US." (ts 30:57)
"Impossible" is a bold qualifier. Maybe he was exaggerating - maybe not. Will critical thinking necessarily become more difficult - to learn, teach, exercise - with AI? It's possible it will help people become better thinkers, but I don't think that's a guarantee.
What is Google supposed to win at? Being the most popular search engine? Being the highest grossing ad agency? Having the highest average salaries? Selling the most used cars? Curing cancer? Owning more generators than anyone else? Contributing money to youth groups? How do we judge whether Google is winning?
At about 39 minutes in, he's asked if efforts analogous to seti at home can be used to get around the scaling problems with training the next round of big models.
He gives a strongly NVidia oriented answer that I happen to think is dead wrong. Pushing more and more GPU/Memory bandwidth into more and more expensive packages that are obsolete after a year or two isn't the approach that I think will win in the end.
I think systems which eliminate the memory/compute distinction completely, like FPGA but more optimized for throughput, instead of latency, are the way to go.
Imagine if you had a network of machines, that could each handle one layer of an LLM with no memory transfers, your bottleneck would be just getting the data between layers. GPT 4, for example, is likely a 8 separate columns of 120 layers of of 1024^2 parameter matrix multiplies. Assuming infinitely fast compute, you still have to transfer at least 2KB of parameters between layers for every token. Assuming PCI Express 7, at about 200 Gigabytes/second, that's about 100,000,000 tokens/second across all of the computing fabric.
Flowing 13 trillion tokens through that would take 36 hours/epoch.
Doing all of that in one place is impressive. But if you can farm it out, and have a bunch of CPUs and network connections, you're transferring 4k each way for each token from each workstation. It wouldn't be unreasonable to aggregate all of those flows across the internet without the need for anything super fancy. Even if it took a month/epoch, it could keep going for a very long time.
I think you need higher algorithmic intensity. Gradient descent is best for monolithic GPUs. There could be other possibilities for layer-distributed training.
[+] [-] ChrisArchitect|1 year ago|reply
[+] [-] neilv|1 year ago|reply
[+] [-] gorgoiler|1 year ago|reply
> Schmidt: Google decided that work life balance and going home early and working from home was more important than winning. The reason startups work is because the people work like hell. I'm sorry to be so blunt, but the fact of the matter is if you go found a company and compete against the other startups — like [we did] in the early days of Google — you're not going to let people work from home and only come in one day a week.”
It’s pretty cack-handed to publicly talk about your successor like that. While the WFH part of this got a lot of press I wonder if the free-wheeling side-swipe at Sundar Pichai had more to do with the cringe backpedaling.
Also, the humblebrag about his medal!… he’s an investor!… he showed Sam Altman his calculations that OpenAI will need lots of electricity!… he’s an investor!… he wrote a report setting national AI policy that was “only about 752 pages long”!… he’s an investor!
Schmidt has done some amazing things and his achievements will eclipse many others but I do wonder if even he feels a bit of the post-FAANG blues where one misses the glory days of ones peak, over performing and telling everyone about it to show you’ve still got it.
[+] [-] tialaramex|1 year ago|reply
Huh, I guess I dreamed the first start-up I worked for (a couple of decades ago) where indeed I only came in one day a week.
Yes of course you "work like hell". We had a nasty leak bug and I set things up so that day or night if the leak was detected my stereo would go maximum volume and play "Straight Outta Compton". How does commuting count as "working like hell" ?
If I'm sat in a car (and once a week I often was) then I'm not working am I? I am useless for several hours each day we do that. Maybe sometimes the CTO (who is in the car, he's driving, he worked from home too) is discussing relevant technology, you know design of our secret sauce schema-less database engine, IP stuff - but then it's also possible we're discussing the album that's playing, or a video game we both enjoyed, or a novel we're both reading.
[+] [-] nextos|1 year ago|reply
Regardless, I found it surprising Schmidt didn't talk about other stuff that differentiates startups. Smaller teams, a lot less red tape, a lot more ownership, less politics... Google should really follow Steve Jobs 2011 advice to Page about focus. Breaking down into a conglomerate was a great idea to bring focus and agility, but it has not been fully executed and lots of the different resulting entities seem dysfunctional.
[+] [-] PostOnce|1 year ago|reply
People who worked at Google early on were always going to get rich, people who bust ass for Google now might wake up to a 10,000 man layoff in the morning.
/me shrugs
[+] [-] ChuckMcM|1 year ago|reply
[+] [-] 1024core|1 year ago|reply
Correction: this statement was made by the interviewer, Erik Brynjolfsson, and not Schmidt.
[+] [-] rodgerd|1 year ago|reply
[+] [-] llm_trw|1 year ago|reply
For those that don't know:
>In early 1934, Clarence Hickman, a Bell Labs engineer, had a secret machine, about six feet tall, standing in his office. It was a device without equal in the world, decades ahead of its time. If you called and there was no answer on the phone line to which Hickman’s invention was connected, the machine would beep and a recording device would come on allowing the caller to leave a message.
>Soon after Hickman had demonstrated his invention, AT&T ordered the Labs to cease all research into magnetic storage, and Hickman’s research was suppressed and concealed for more than sixty years, coming to light only when the historian Mark Clark came across Hickman’s laboratory notebook in the Bell archives.
>AT&T firmly believed that the answering machine, and its magnetic tapes, would lead the public to abandon the telephone.
https://gizmodo.com/how-ma-bell-shelved-the-future-for-60-ye...
The same thing was true for google, with the very real threat that something like perplexity will eat their lunch by having a monthly payment and no adds. With google relegated to a second tier API endpoint.
20 years of AI advancements were used for better add targeting in gmail, and in the months after chatgpt came out, a better spell checker.
[+] [-] toomuchtodo|1 year ago|reply
[+] [-] aaron695|1 year ago|reply
[deleted]
[+] [-] ldjkfkdsjnv|1 year ago|reply
[+] [-] zniturah|1 year ago|reply
[+] [-] metadat|1 year ago|reply
https://gist.github.com/sleaze/bf74291b4072abadb0b4109da3da2...
And here's the related submission:
Former Google CEO Eric Schmidt's Leaked Stanford Talk - https://news.ycombinator.com/item?id=41263143 (2 days ago, 466 comments)
Edit: Broken gist link fixed. Thanks @ryanwhitney!
[+] [-] otteromkram|1 year ago|reply
[+] [-] congulio|1 year ago|reply
[+] [-] spacemadness|1 year ago|reply
[+] [-] pierrefermat1|1 year ago|reply
[+] [-] nirui|1 year ago|reply
Put that aside, Eric Schmidt did told the truth (maybe except AI and NVidia stock thing) and offered the public a glace of how things actually work within the industry.
One important thing he mentioned was (after simplified) "just steal, and deal with justice later", which actually mirrors what Steve Jobs once said "Great artist steal". This should remind everyone, that if you want to have significant achievement in this industry, you at least needs to guard against thefts, because there WILL BE (maybe ALREDY are) people who comeout with a "be shameless or be dead" mindset after been educated by people like that man.
(Also, I found it quite funny that one of Eric's girl friend has probably took his lesson too)
[+] [-] zombiwoof|1 year ago|reply
[+] [-] 1oooqooq|1 year ago|reply
[+] [-] metadat|1 year ago|reply
Are there non-youtube hosted copies out there, perhaps an archive.org or torrent link?
[+] [-] Maxious|1 year ago|reply
[+] [-] Spartan-S63|1 year ago|reply
[+] [-] shombaboor|1 year ago|reply
[+] [-] kkfx|1 year ago|reply
- Alphabet have made a switch from a (mostly) tech-driven company to a pure finance-driven one, when this happen you can expect a bit of growth, even a sharp one for a little time, than an inexorable decline;
- the more and more centralized web means search engine became dysfunctional beasts try to pour water to specific mill instead of being open search and for a company living on search more than anything else it's a problem, of course there is GMail a project born when Google was tech-driven, but again GMail is search, so Drive, and in that "specific domain" they have substantial competitors and they can't have innovation being financially-driven now;
- LLM-push a way to reach a kind of dummy semantic holy grail of research while very popular is a substantial failure. Yes it have a certain wow-effect, but results are such low quality that the wow effect will not last longer and current "better-than-Alphabet" competitors in that field still have to see any meaningful and durable growth and profit.
Long story short the anti-remote-working is just another droplet in a substantially lost PR/élite battle to force people in the city, the sole way they have to remain alive because finance and services can only live at large city scale where they own anything and they rent/sell services to anyone. In a spread world they simply die killed by SME innovation and personal ownership that value substantial innovation against services.
IMVHO the big-tech model, a cleptocracy born out of Xerox tech once they have found a way to make it anti-user, is at it's end. I do not know what could happen next because so far ALL élites want such model to rule slaves, and we have lost much of intelligence, competence of the Xerox time, and no one else in the world seem to be there, China included, who was able to surge as an industrial power but still lag behind in software, even in the current sorry state of IT. But it's clear that the service model of big tech is dead. Or they found a way to reinvent or they are done.
[+] [-] keiferski|1 year ago|reply
The analogy here might be between nuclear weapons and drones; the former are controlled entirely by a small number of countries, but the latter probably have more of a direct role to play in the future of warfare - and yet aren’t costly or difficult to make at all. The assumption tends to be that the most powerful well-capitalized tech always wins, but I don’t think that is necessarily the case.
[+] [-] flawn|1 year ago|reply
https://news.ycombinator.com/item?id=40576466
[+] [-] mattigames|1 year ago|reply
> The fact of the matter is this is a rich country's game, right?
You heard it straight from the wolves mouth folks, don't act surprise when they bite.
[+] [-] keiferski|1 year ago|reply
Please read/listen to the link before commenting on out of context sections.
[+] [-] 1oooqooq|1 year ago|reply
when anyone with half a brain can see that work life balance has much less impact on a tech company than replacing the tech founders with the likes of him and a sea of business major middle Managers...
[+] [-] habosa|1 year ago|reply
But yeah, he’d have won AI by keeping butts in seats…
[+] [-] the_black_hand|1 year ago|reply
[+] [-] aaomidi|1 year ago|reply
Google’s WLB ironically got significantly better after the layoffs. No one cared about the company anymore.
[+] [-] unknown|1 year ago|reply
[deleted]
[+] [-] wunderlust|1 year ago|reply
"Impossible" is a bold qualifier. Maybe he was exaggerating - maybe not. Will critical thinking necessarily become more difficult - to learn, teach, exercise - with AI? It's possible it will help people become better thinkers, but I don't think that's a guarantee.
[+] [-] fuzztester|1 year ago|reply
See the "Public positions" section of the above article.
[+] [-] unknown|1 year ago|reply
[deleted]
[+] [-] freeopinion|1 year ago|reply
[+] [-] mikewarot|1 year ago|reply
He gives a strongly NVidia oriented answer that I happen to think is dead wrong. Pushing more and more GPU/Memory bandwidth into more and more expensive packages that are obsolete after a year or two isn't the approach that I think will win in the end.
I think systems which eliminate the memory/compute distinction completely, like FPGA but more optimized for throughput, instead of latency, are the way to go.
Imagine if you had a network of machines, that could each handle one layer of an LLM with no memory transfers, your bottleneck would be just getting the data between layers. GPT 4, for example, is likely a 8 separate columns of 120 layers of of 1024^2 parameter matrix multiplies. Assuming infinitely fast compute, you still have to transfer at least 2KB of parameters between layers for every token. Assuming PCI Express 7, at about 200 Gigabytes/second, that's about 100,000,000 tokens/second across all of the computing fabric.
Flowing 13 trillion tokens through that would take 36 hours/epoch.
Doing all of that in one place is impressive. But if you can farm it out, and have a bunch of CPUs and network connections, you're transferring 4k each way for each token from each workstation. It wouldn't be unreasonable to aggregate all of those flows across the internet without the need for anything super fancy. Even if it took a month/epoch, it could keep going for a very long time.
[+] [-] jl2718|1 year ago|reply
[+] [-] labster|1 year ago|reply
[+] [-] bartimus|1 year ago|reply