It boils down to the implementation. Actually, player is never moving but the stuff around you do depending on the mouse position. Basically, it imitates movement, and that has some weird side effects like bullets being unavoidable. I decided that if it works that way, let's build a game with this in mind and put collecting star minions to protect yourself the main way to survive and progress. It is not ideal and if I will come back to this project I will change these mechanics.