Right click on Ninja to open the context menu (it's easier to catch it while it's on the ground), then select "Close".If that menu isn't popping up, that's a bug, but task manager should do the trick.
