I think polishing out the mechanic will be perfect, I like the idea a lot and I think you could expand on the concept a lot! Was frustrating trying to aim, but I got a fair bit of them :)
If you get a sec this week, would love for you to check my out submission and drop a rating! https://itch.io/jam/vr-super-jam/rate/1249489