[magusor]

The folks at ALVR (another vr streaming client/server) are doing something similar, but are open source : https://github.com/alvr-org/alvr

They also achieve very low latency, I didn't follow every single optimization they added but it basically boils down to a few encoding tricks (better image in the center, accept blurriness in the peripheral vision), good network infrastructure, and hardware decoding / encoding being really fast.