Thanks for the feedback. It's the first time I made a game like this and in a future game I think I would change this completly by having the "interaction signal" based on the player (Screen Space) instead of on the object (World Space).
That probaply is also way easier to implement (It would only need one element).
I noticed that this is also what most other games with FPS camera do.