Simply replacing the 3090's with 4090's would provide a major performance uplift assuming your model fits. (I have rented both 3090 and 4090 systems online for research, this comment is based on my personal experience, it is well worth the price increase and the hourly rate for the inference speed you get)
tryauuum|5 months ago
there are patched drivers for enabling p2p but if I remember correctly, they are still slower than having an nvlink