top | item 45467471

Pretraining Under Infinite Compute

3 points| jedharris | 5 months ago |arxiv.org

1 comment

order

jedharris|5 months ago

"Our results show that simple algorithmic improvements can enable significantly more data-efficient pre-training in a compute-rich future."