(no title)
snickmy | 11 months ago
You have a desire to be relevant in an important technological shift.
On one side, you have big tech companies laser-focused on attracting the best talent and putting them in a high-pressure cooker to deliver real business outcomes, under a leadership group that has consistently proven effective for the last XX years.
On the other side, you have universities, led by the remnants of that talent pool—those who were left behind in the acquisition race—full of principles and philosophical opinions but with little to no grounded experience in actual execution. Instead, you find a bunch of PhD students who either didn’t make the cut to be hired by the aforementioned tech companies or lack the DNA to thrive in them, actively avoiding that environment. Sprinkle on top several layers of governmental bureaucracy and diluted leadership, just to ensure everyone gets a fair slice of the extra funding.
I'm surprised anyone is surprised.
auggierose|11 months ago
The problem really is that universities are treated as if they have the same mandate as industry. Government people shouldn't tell a professor what kind of research is interesting. They should let the best people do what they want to do.
I remember an acquaintance becoming a professor, promoted from senior reader, and he was going to be associated with the Alan Turing Institute. I congratulated him, and asked him what he was going to do now with his freedom. He answered that there were certain expectations of what he would be doing attached to his promotion, so that would be his focus.
This way you don't get professors, you turn good people into bureaucrats.
pjc50|11 months ago
Mind you, it was evident to me even twenty years ago when briefly considering a PhD that CS research not focused on applying itself to users would .. not be applied and languish uselessly in a paper that nobody reads.
I don't have a good answer to this.
(also, there is no way universities are going to come up with something which requires LLM like levels of capital investment: you need $100M of GPUs? You're going to spend a decade getting that funding. $10bn? Forget it. OpenAI cost only about half of what the UK is spending on its nuclear weapons programme!)
jimmaswell|11 months ago
harvey9|11 months ago
snickmy|11 months ago
Yet, European leaders have not got the memo, and expect the same level of output.
dingnuts|11 months ago
What DO we rely on that has come out of MIT this century? I'm having a real hard time thinking of examples.
sfpotter|11 months ago
There's loads of worthwhile research to do that has nothing to do with LLMs. A lot of it will not or cannot be done in an industrial environment because the time horizon is too long and uncertain. Stands to reason that people who thrive in a "high-pressure cooker" environment are not going to thrive when given a long-term, open-ended goal to pursue in relative solitude that requies "principles and philosophical opinions" that aren't grounded in "actual execution". That's what makes real (i.e. basic) research hard and different as opposed to applied research. Lots of people in industry claiming to be researchers or scientists who are anything but.
daveguy|11 months ago
robertlagrant|11 months ago
> For example, neither the key advance of transformers nor its application in LLMs were picked up by advisory mechanisms until ChatGPT was headline news. Even the most recent AI strategies of the Alan Turing Institute, University of Cambridge and UK government make little to no mention of AGI, LLMs or similar issues.
Almost any organisation struggles to stay on task unless there's a financial incentive or another driver, such as exceptional staff/management in place. Give them free money - the opposite of financial incentive - and the odds drop further.
gorgoiler|11 months ago
Many of the best Engineering and Computer Science departments, around the world, operate a revolving door for people to go in and out of industry and academia and foster the strongest of relationships bridging both worlds.
Look at Roger Needham’s Wikipedia page and follow his academic family tree up and down and you’ll see what I mean.
https://en.m.wikipedia.org/wiki/Roger_Needham
aleph_minus_one|11 months ago
I do believe that these people at universities do have experience in the actual execution - of doing research. What they obviously have less experience in is building companies.
> Instead, you find a bunch of PhD students who either didn’t make the cut to be hired by the aforementioned tech companies
Or because they live in a country where big tech is not a thing. Or because these people simply love doing research (I am rather not willing to call what these AI companies are doing "research").
tene80i|11 months ago
WhyOhWhyQ|11 months ago
I'm frequently and sadly reminded when I visit this website that lot of (smart) people can't seem imagine any form of success that doesn't include common social praise and monetary gain.
rhubarbtree|11 months ago
https://www.ettf.land/p/30-reflections
jimmaswell|11 months ago
sfpotter|11 months ago
heavymetalpoizn|11 months ago
[deleted]