We have full screen option in the in game menu, or you can use alt + enter to toggle.
But if it's not you want, that's the game engine limitation, we afraid that we can not solve it.
Nah I figured it out after posting the question. It's exactly what I was looking for. Thanks.