[madelyn]

Sound is a lot higher fidelity, it's harder to make the information available to a computer without serious downsampling or simplification.

Consider sounds over 12khz. On a spectrogram during a chorus or drop that area is lit up, with so many things changing from millisecond to millisecond. A lot of AI samples really struggle at high frequencies, or even forgo them entirely.

Midi based approaches have been really great though, and an approach like in the OP is fascinating (and impressive).