[yosefk]

A lot of people including "me" (TFA author, of course "me" = larger team) were doing hardware matrix multiplication for many years before 2012 [let's say before deep learning.] I count "moving data around" as "dispatching costs" [dispatching = figuring out what to do, on what data and where to put results as opposed to actually doing it.]

[Symmetry]

It's entirely possible my terminology is wrong here. I was thinking of the cost of decode, register renaming, and scheduling but those aren't really part of dispatch, are they? So it looks like I more got things backwards but I think the point that there are different sorts of cost savings worth distinguishing through using more capable instructions is still salvageable.