top | item 34975691 (no title) ckosidows | 3 years ago "hipsters", "Apple fanboys" and "normie" - I'm convinced this was trained on Reddit posts from 2015 discuss order hn newest CSMastermind|3 years ago https://arxiv.org/pdf/2005.14165.pdfWebText and WebText2 referenced in their papers are corpuses based on Reddit submissions which had a 22% weight in their training model.https://openwebtext2.readthedocs.io/en/latest/This is larger than Wikipedia (3% weight) or either of their two book corpuses (8% each).The only other data included was a filtered set from Common Crawl (weighted 60%). incahoots|3 years ago 4chan stuck out to me, especially since they coined the term "normie" jrumbut|3 years ago Normie is pretty old, the following article suggests the 1950s: https://www.dictionary.com/e/slang/normie/ load replies (1) Slighted|3 years ago 4channers use Normalfag. "Normie" is the sanitized version for Redditors and Youtubers that are too afraid to use the -fag suffix. Same with the "Glowie" meme. load replies (1) hot_gril|3 years ago The only reason I don't think it's 4chan is it doesn't mention Gentoo. jeron|3 years ago peak normie take
CSMastermind|3 years ago https://arxiv.org/pdf/2005.14165.pdfWebText and WebText2 referenced in their papers are corpuses based on Reddit submissions which had a 22% weight in their training model.https://openwebtext2.readthedocs.io/en/latest/This is larger than Wikipedia (3% weight) or either of their two book corpuses (8% each).The only other data included was a filtered set from Common Crawl (weighted 60%).
incahoots|3 years ago 4chan stuck out to me, especially since they coined the term "normie" jrumbut|3 years ago Normie is pretty old, the following article suggests the 1950s: https://www.dictionary.com/e/slang/normie/ load replies (1) Slighted|3 years ago 4channers use Normalfag. "Normie" is the sanitized version for Redditors and Youtubers that are too afraid to use the -fag suffix. Same with the "Glowie" meme. load replies (1) hot_gril|3 years ago The only reason I don't think it's 4chan is it doesn't mention Gentoo. jeron|3 years ago peak normie take
jrumbut|3 years ago Normie is pretty old, the following article suggests the 1950s: https://www.dictionary.com/e/slang/normie/ load replies (1)
Slighted|3 years ago 4channers use Normalfag. "Normie" is the sanitized version for Redditors and Youtubers that are too afraid to use the -fag suffix. Same with the "Glowie" meme. load replies (1)
CSMastermind|3 years ago
WebText and WebText2 referenced in their papers are corpuses based on Reddit submissions which had a 22% weight in their training model.
https://openwebtext2.readthedocs.io/en/latest/
This is larger than Wikipedia (3% weight) or either of their two book corpuses (8% each).
The only other data included was a filtered set from Common Crawl (weighted 60%).
incahoots|3 years ago
jrumbut|3 years ago
Slighted|3 years ago
hot_gril|3 years ago
jeron|3 years ago