[deadalus]

I wish AMD did well in the Stable Diffusion front because AMD is never greedy on VRAM. The 4060Ti 16GB(minimum required for Stable Diffusion in 2024) starts at $450.

AMD with ROCm is decent on Linux but pretty bad on Windows.

[Adverblessly]

I run A1111, ComfyUI and kohya-ss on an AMD (6900XT which has 16GB, the minimum required for Stable Diffusion in 2024 ;)), though on Linux. Is it a Windows specific Issue for you?

Edit to add: Though apparently I still don't run ollama on AMD since it seems to disagree with my setup.

[wastewastewaste]

You don't need 16gb, literally majority of people don't have that and use 8gb and up. especially with forge

[choilive]

They bump up VRAM because they can't compete on raw compute.

[wongarsu]

Or rather Nvidia is purposefully restricting VRAM to avoid gaming cards canibalizing their supremely profitable professional/server cards. AMD has no relevant server cards, so they have no reason to hold back on VRAM in consumer cards

[risho]

it doesn't matter how much compute you have if you don't have enough vram to run the model.

[api]

They lag on software a lot more than the lag on silicon.