it is OK to make a game that can only be played qith controller (it is also fine if it can only be played with keyboard or any other combo of inputs). Please note in the game itself to let players know ^_^
