top | item 44927989 (no title) reasonableklout | 6 months ago Oh yes, according to [1], training GPT-2 1.5B cost $50k in 2019 (reproduced in 2024 for $672!).[1]: https://www.reddit.com/r/mlscaling/comments/1d3a793/andrej_k... discuss order hn newest stavros|6 months ago That makes sense, and it was definitely impressive for $50k.
stavros|6 months ago