top | item 45848926 (no title) mshockwave | 3 months ago Is it normal to spend 10minutes on tuning nowadays? Do we need to spend another 10 minutes upon changing the code? discuss order hn newest anvuong|3 months ago You mean autotune? I think 10 minutes is pretty normal, torch.compile('max-autotune') can be much slower than that for large models. Mars008|3 months ago Add to that it can be done only once by developers before distribution for major hardware. Configs saved. Then on client side selected.
anvuong|3 months ago You mean autotune? I think 10 minutes is pretty normal, torch.compile('max-autotune') can be much slower than that for large models. Mars008|3 months ago Add to that it can be done only once by developers before distribution for major hardware. Configs saved. Then on client side selected.
Mars008|3 months ago Add to that it can be done only once by developers before distribution for major hardware. Configs saved. Then on client side selected.
anvuong|3 months ago
Mars008|3 months ago