top | item 35784252

(no title)

rapsacnz | 2 years ago

Don't forget that GPT was trained on data from all the sources that failed you. So if we all collectively neglect them, and they fall over, we will lose many valuable resources.

I think we need to think about how to keep these valuable sites going, because they are ultimately providing most of the value of the various available language models.

discuss

order

wrycoder|2 years ago

The sources didn’t fail. The point is, especially at the beginning, it’s easy to miss seeing the forest for all the trees.

rapsacnz|2 years ago

By "failed" I meant "Proved hard to parse". I don't think they failed at all.