[semi-extrinsic]

For solving physics equations there is also Jacobian-free Newton-Krylov methods.

[conformist]

Yes the combination of Krylov and quasi-Newton methods are very successful for physics problems (https://en.wikipedia.org/wiki/Quasi-Newton_method).

Iirc eg GMRES is a popular Krylov subspace method.