The 0.8.0 changelog mentions some changes to shadows (don't know if in general or for performance) so it could be related to that, The 0.8.1 changelog mentions better performance so it might help/fix this.
Thanks, ill try it out!