[minzi]

Thank you for your insight! I was planning on checking out triton too once I got a baseline understanding of gpu programming in general. The problem you described is right in the realm of problems that I am interested in working on. I’m really looking to work on finding efficiency in distributed training and inference.