top | item 39905274

(no title)

tamarlikesdata | 1 year ago

Hugging Face Transformers is your best bet. It's pretty straightforward and has solid docs, but you'll need to get your hands dirty a bit with setup and configs.

For squeezing every bit of performance out of your GPU, check out ONNX or TensorRT. They're not exactly plug-and-play, but they're getting easier to use.

And yeah, Docker can make life a bit easier by handling most of the setup mess for you. Just pull a container and you're more or less good to go.

It's not quite "idiot-proof" yet, but it's getting there. Just be ready to troubleshoot and tinker a bit.

discuss

order

No comments yet.