You're kind of narrowing your potential audience with a VR game, that could explain the divergence of clicks to downloads: "Ooh cool looking game! Too bad I don't have a gazillion dollar piece of equipment...
Diversifying with a non-VR game might help. Alternatively, getting some of those sweet, sweet Normie Eyeballs with some Facebook Ads.