top | item 35064301

(no title)

ugurnot | 3 years ago

I evaluated ChatGPT on Winogrande Debiased validation set[1], a dataset focused on commonsense reasoning. ChatGPT has an accuracy of 62.75%, below GPT-3's reported accuracy of 77.7%.

https://github.com/ugorsahin/Winogrande_ChatGPT

discuss

order

No comments yet.