[BloondAndDoom]

This is great stuff, have you tried with local models? Summarization etc. is easy but I haven’t played with image to text models locally? Any ideas. I can run 32b models fine and for summarization kind of tasks they are extremely good I’d even say more than necessary

[fidorka]

Hey, just released a new version with support for local models - you just configure the custom endpoint and model name and it should just work. Let us know what you think:)