I have fixed the problem with mouse pointer moving out of viewport which makes it much easier to control at least.
