masterblaster
I have been trying various things since you posted. In the network settings, it says I am connected at 2.4Mhz via my Oculus and it says that I have a Receive Link Speed of 54Mbps.
No wonder you are getting problems when using 2,4GHz, and a link speed of 54Mbps may be an indication that you are even using age-old 802.11g, or otherwise you are already at a range your WiFi signal is very weak.
Also remember, WiFi, actually every network technology always quotes the datarate on the carrier. With cable this is, depending on the protocol, around 80-90% of the actual usable datarate. But with WiFi you could expect realistically about 50% of the link data rate useable for actual data.
And the problem with 2,4GHz is, that everything uses it, WiFi, Bluetooth even microwave ovens can interfere 2,4GHz. In best case with 2,4GHz you can get 3 non overlapping channels, so if there are more then 3 WiFis in your range you are always effectively share bandwidth.
You should use 5GHz and at least 802.11ac (which actually is only available on 5GHz anyway)