Philip You're right, you would lose quality, but honest question: How would you try to offer multiple perspectives then? I'm genuinely curious. I've watched and stitched some Pervrt scenes together for 180 where the perspective spliced together and I enjoyed it more than the regular vids, but I edited it so it was tailored toward my preferences whereas others might have different tastes, and you don't have freedom in the moment to swap back and forth. You could also splice the two POV angles together in a 180 scene like I have, but you do lose out on the spontaneity actively swapping offers.
Maybe this whole line of thinking is better suited for a more interactive video player with the ability to swap between two videos in sync at the press of a button rather than working the video format within the confines of the current video players. ¯_(ツ)_/¯