[garyiskidding]

This is a great idea. I assume that inference costs will be higher for the time being, but it does aim to solve a real problem. Kudos..!

[vercantez]

Thanks! Yes inference costs are non-negligible right now but we think this will come down over time