(no title)
Mockapapella | 9 months ago
Normally I'd send this as a DM or email, but I think it could be useful for others to learn about how to use your service/the limitations of it. A couple weeks ago I made a search for:
In early 2023, Andrej Karpathy said something like "large training runs are a good test of the overall health of the network." Something something resilience as well I think. I need you to find it.
Unfortunately it wasn't able to find it, but it was either in a tweet or a really long presentation, neither of which are good targets for search. It was around the same time that this (https://www.youtube.com/watch?v=c3b-JASoPi0) video was posted, like within a couple weeks before or after. How could I have improved my query? Does exa work over videos?
liam-hinzman|9 months ago
> TLDR LLM training runs are significant stress-tests of an overall fault tolerance of a large computing system acting as a biological entity.
https://x.com/karpathy/status/1765424847705047247
Mockapapella|9 months ago