top | item 46366668

(no title)

ThouYS | 2 months ago

it's quite the bummer. some models you simply can't export with dynamo. for the time being the jit exporter is the only good option.

in particular selective function scripting is essential!

discuss

order

drag0nblad3|2 months ago

ExecuTorch developer here, agreed it's a huge pain to deal with if conditions right now. Part of the pain comes from the vast expressiveness of python on if condition, which causes all ML compiler a lot of headache to be able to capture a sound graph. The rest of the pain comes from the strict requirement of torch.compile itself (no mutation/aliasing behavior in the if branches), which in often times makes torch.cond hard to use or inefficient.

fooblaster|2 months ago

And you wouldn't happen to know about a torchscript replacement that is currently in-flight that is not based on export?

fooblaster|2 months ago

So what are your users doing to get around this? Hoisting all control flow out?

fooblaster|2 months ago

Anyway, perhaps we can chat in the executorch discord.