top | item 43755847

(no title)

aazo11 | 10 months ago

Exactly. Why does this not exist yet?

discuss

order

byyoung3|10 months ago

its an if statement on whether the model has downloaded or not

aazo11|10 months ago

A better solution would train/finetune the smaller model from the responses of the larger model and only push to the inference to the edge if the smaller model is performant and the hardware specs can handle the workload?