Bug Summary update: Changing any setting, will cause fps to plummet.
I have found that changing my settings caused the game's default audio output to select my VR headset (which is not connected most of the time). After I finally managed to log in, I managed to change the audio output device to my speakers and the game runs perfectly well again.
FPS with Oculus virtual audio device selected:
FPS with any other audio device selected: