A bit tricky, I think adding like an additional guide might help (Like Clubhouse 51 Games pool) then you could make more complex puzzles and such. Other than that awesome concept, I always wondered how it was like setting up those mini putt courses.
edit: Congrats on the music and sound design! It really fits with the game :D