top | item 44829301 (no title) earino | 6 months ago Ok wonderful! Thanks.I'm trying to set it up right now with lmstudio with qwen3-coder-30b. Hopefully it's going to work. Happy to take any pointers on anything y'all have tried that seemed particularly promising. discuss order hn newest reissbaker|6 months ago For sure! We also have a Discord server if you need any help: https://discord.gg/syntheticlab earino|6 months ago Follow up question, can the diff apply and fix json models be run locally as well with octofriend, or do they have to hit your servers? Thanks! load replies (1) jasonjmcghee|6 months ago I think this might be your best bet right now. GLM-4.5-Air is probably next best. I'd run them at 8-bit using MLX.
reissbaker|6 months ago For sure! We also have a Discord server if you need any help: https://discord.gg/syntheticlab earino|6 months ago Follow up question, can the diff apply and fix json models be run locally as well with octofriend, or do they have to hit your servers? Thanks! load replies (1)
earino|6 months ago Follow up question, can the diff apply and fix json models be run locally as well with octofriend, or do they have to hit your servers? Thanks! load replies (1)
jasonjmcghee|6 months ago I think this might be your best bet right now. GLM-4.5-Air is probably next best. I'd run them at 8-bit using MLX.
reissbaker|6 months ago
earino|6 months ago
jasonjmcghee|6 months ago