(no title)
suthakamal | 8 months ago
I take Sutton's Bitter Lesson to basically say that compute scale tends to win over projecting what we think makes sense as a structure for thinking.
I also think that as we move away from purely von neumann architectures to more neuromorphic things, the algorithms we design and ways those systems will scale will change. Still, I think I agree that scaling compute / learning will continue to be a fruitful path.
No comments yet.