Maybe the problem is that actual reality is very three dimensional, and incredibly detailed and immersive.

The people who can afford thousands of dollars on VR gear that will be obsolete in three years generally spend their days in nice environments.

If you want VR to catch on, make it dirt cheap, so that people in crummy circumstances can use it to escape from reality.