MosaicML MPT-7B: A Commercially-Usable LLaMa-Quality Model

[jpdus]

I wonder why this is getting so few traction here.

These models seems to beat all other available open-source models easily and the Blogpost is extremely well written, with very good documentation and fine-tuning instructions.

Well done MosaicML, I am excited what comes next and will definitely test out you platform!

[deepsquirrelnet]

I'm perplexed as well. Here's a model with commercial use licensing that is competitive (better in half of the major benchmarks) with llama 7B, and has been tuned in several variants and has 2048 token width inputs.

This is BY FAR the best model of its size that is usable by businesses. I plan to start testing it out soon.

[djoldman]

Looks competitive with LLaMa:

https://assets-global.website-files.com/61fd4eb76a8d78bc0676...

[meghan_rain]

what about gpt3.5? i know it's worse but how much?

[ml_hardware]

The repo for training and finetuning this model is open source here: https://github.com/mosaicml/llm-foundry

[vsroy]

This has a context window of 65K for the storywriter version.

[ftxbro]

How can I run some inference with this model locally? Do I have to make a huggingface account?

[edtechdev]

I'm not sure, but maybe GPT4All will eventually add support for it: https://gpt4all.io/

[fswd]

if you can't figure it out send me an email and I can help you figure it out