There's no penalty for doing that. All checks so far require sufficient power OR skill, so as long you keep up on skill, you can forego the power gains from corruption.
