it seems that there is a small bug or error that makes that when you face your rival in combat, if he defeats you when you used the muscle gain spell to the maximum (your stats are infinite) it is bugged and you keep all that size, even with the combat finished.
edit: if you're wondering how the hell he beat me with those stats? i gave him strength by accident, leaving his stats at maximum too and he kicked my ass.