I love the idea of an ability having a time penalty! I think that's a really creative way to encourage different routing instead of just flying all the time.
This actually could be an issue in a speedrun contest ; speedrun is about how long it actually takes to finish the game, if you minimize some virtual "in game" timer, it is more scoring than speedrunning.
