top | item 44422165

Baidu: The Open Source Release of the Ernie 4.5 Model Family

9 points| fcanesin | 8 months ago |ernie.baidu.com

2 comments

order

fcanesin|8 months ago

ERNIE 4.5, a new family of large-scale multimodal models comprising 10 distinct variants. The model family consist of Mixture-of-Experts (MoE) models with 47B and 3B active parameters, with the largest model having 424B total parameters, as well as a 0.3B dense model.

jeanlucas|8 months ago

Anyone trying it out? There's a paper accompanying it