WingNews logo WingNews
top | item 35099539

(no title)

testcase_delta | 3 years ago

Does anyone know how this fits with (or not) Chomsky's ideas of language processing?

discuss

order

IIAOPSW|3 years ago

    |-----long timing loop / top of parse tree-----|
    |                                              |
    |-shorter / child node -|                      |-shorter / child node-|
    |                       |                      |                      |
    |highest freq|          |highest freq|         |highest freq|         |highest freq|

politician|3 years ago

Similarly, ChatGPT (gpt2-medium) has 12 heads of attention. GPT-3 has 96.

convolvatron|3 years ago

the idea that some linguistic facilities are innate? or the government binding model of grammar or something else?

for the first two, I think this orthogonal

YeGoblynQueenne|3 years ago

What are Chomsky's ideas on language processing? He's a linguist, not an NLP person.