[dr0l3]

I don't have anything valid to back up my claims here, so take what i have with a grain of salt unless you find external validation for it. That being said i will venture a guess:

Yes and no. Neural networks have a lot of nice properties like being easier to grasp, easier to parrallelize(?) and have better tools which i guess is because neural networks are applicable to more problems than SVM's because they are extensible.( see https://en.wikipedia.org/wiki/Recurrent_neural_network for example).

Either way SVM's still do what they do very nicely and in the field of "Human Activity Recognition" where i did my thesis neural networks are practically never used but SVM's pop up from time to time.

[mathgenius]

Right, scalability is a good point to consider. Along the same vein, my last ml job we ended up using gradient boosting which worked really well, but definitely does not scale to big data (afik.) Robustness is another thing to consider, both svm's and neural networks need a reasonable amount of data-massaging before they behave themselves. Hence the success in image processing where every pixel can be treated equally.