20100thibault | 3 years ago | on: Liquid and immersion is the new cool at Supercomputing '22
20100thibault's comments
20100thibault | 3 years ago | on: Liquid and immersion is the new cool at Supercomputing '22
First, we are designing smaller transistor leading to leakage and thus increasing chip thermal design power (TDP). We are also using bigger chips and chiplets also increasing TDP.
TDP on a GPU went from 200w to 1 kW in the past 5 years and even CPU are now close to 500w. At 25k a pop avoiding throttling due to heat restriction is a must and is becoming incredibly hard with air cooling as air is an amazing insulator.
Second, networking is extremely expensive with the cost of top-end InfiniBand cable close to 1000$ a foot. This means you want to cram your CPU /GPU as close as possible to keep the connection electrical if possible and minimize optical cable lengths. This also decreases latency and increase cluster performance. On a 50 000 cable deployment, the saving can be … significant.
Third, we are now seeing the emergence of foundational model that requires government lab levels of interconnected compute. This is a new paradigm in the private sector and consume power in the 20-30 MW range. An increase in efficiency of 10% (from 1.2 to 1.1 PUE) brings huge saving on the power cost side plus important environmental benefits. It also becomes much easier to recuperate heat.
That’s why we’re seeing major announcement at OCP i.e. meta going the liquid cooling way.
I personally believe that’s where things are going and we are building a facility to optimize for the above points: https://www.qscale.com/
20100thibault | 3 years ago | on: LUMI, Europe’s most powerful supercomputer
20100thibault | 4 years ago | on: Liquid cooling next-gen servers getting hands-on
20100thibault | 5 years ago | on: Is Y Combinator worth it?
20100thibault | 7 years ago | on: Oh Dear Elon Has Found Another Con
20100thibault | 9 years ago | on: Elon Musk’s Neuralink wants to boost the brain to keep up with AI
20100thibault | 9 years ago | on: China is challenging the idea that censorship thwarts online innovation
20100thibault | 10 years ago | on: Your Job as a Founder Is to Create Believers
20100thibault | 11 years ago | on: Ask HN: How to become a technical sales engineer?
20100thibault | 11 years ago | on: I’m tired. So I’m selling my game that just went viral
Discounted cashflow = bullshit used to rationalize the sale price ( it can have some use in super long term predictable business like real estate with 10 year lease and well diversified tenants)
Hope this was helpfull
20100thibault | 12 years ago | on: Ask HN: How to hire a sales person for SME?
20100thibault | 13 years ago | on: Warren Buffett: Success in investing doesn't correlate with IQ
20100thibault | 13 years ago | on: Elon Musk - The Future of Energy and Transport [video]
20100thibault | 13 years ago | on: Ask HN: Life as optimization problem
http://www.bwater.com/Uploads/FileManager/Principles/Bridgew...
Both changed my life
Good luck
20100thibault | 13 years ago | on: Ask HN: Why TechCrunch posts often do not make it to the front page of HN?
20100thibault | 13 years ago | on: The impact of Silicon Valley on success
20100thibault | 13 years ago | on: The reality distortion field hidden processes
20100thibault | 13 years ago | on: The reality distortion field hidden processes