There is! Before you press play (or after, by right clicking), go to preferences > Display > fullscreen!
