Well, I seem to be unable to replicate it now, unless the game is in windowed mode and I force it to fullscreen with my window manager instead. Maybe I did that by accident while testing then.
Also, I can't see any sort of difference in behavior between exclusive and borderless window fullscreen modes, not sure if unity even does that on linux.