top | item 47036546 (no title) the_pwner224 | 14 days ago AMD Strix Halo / Ryzen AI Max+ (in the Asus Flow Z13 13 inch "gaming" tablet as well as the Framework Desktop) has 128 GB of shared APU memory. discuss order hn newest scoopdewoop|14 days ago Not quite. They have 128GB of ram that can be allocated in the BIOS, up to 96GB to the GPU. cpburns2009|14 days ago You don't have to statically allocate the VRAM in the BIOS. It can be dynamically allocated. Jeff Geerling found you can reliably use up to 108 GB [1].[1]: https://www.jeffgeerling.com/blog/2025/increasing-vram-alloc... khimaros|14 days ago allocation is irrelevant. as an owner of one of these you can absolutely use the full 128GB (minus OS overhead) for inference workloads load replies (1) hedgehog|14 days ago Keep in mind most of the Strix Halo machines are limited to 10Gbe networking at best. paulsmal|14 days ago you can use separate network adapter with RoCEv2/RDMA support like Intel E810 load replies (1)
scoopdewoop|14 days ago Not quite. They have 128GB of ram that can be allocated in the BIOS, up to 96GB to the GPU. cpburns2009|14 days ago You don't have to statically allocate the VRAM in the BIOS. It can be dynamically allocated. Jeff Geerling found you can reliably use up to 108 GB [1].[1]: https://www.jeffgeerling.com/blog/2025/increasing-vram-alloc... khimaros|14 days ago allocation is irrelevant. as an owner of one of these you can absolutely use the full 128GB (minus OS overhead) for inference workloads load replies (1)
cpburns2009|14 days ago You don't have to statically allocate the VRAM in the BIOS. It can be dynamically allocated. Jeff Geerling found you can reliably use up to 108 GB [1].[1]: https://www.jeffgeerling.com/blog/2025/increasing-vram-alloc...
khimaros|14 days ago allocation is irrelevant. as an owner of one of these you can absolutely use the full 128GB (minus OS overhead) for inference workloads load replies (1)
hedgehog|14 days ago Keep in mind most of the Strix Halo machines are limited to 10Gbe networking at best. paulsmal|14 days ago you can use separate network adapter with RoCEv2/RDMA support like Intel E810 load replies (1)
paulsmal|14 days ago you can use separate network adapter with RoCEv2/RDMA support like Intel E810 load replies (1)
scoopdewoop|14 days ago
cpburns2009|14 days ago
[1]: https://www.jeffgeerling.com/blog/2025/increasing-vram-alloc...
khimaros|14 days ago
hedgehog|14 days ago
paulsmal|14 days ago