If you successfully romance Jasper he will ask you to stay on the Isle with him.
-make sure you are on the observe path (no romances or political marriages)
-make sure you visit him in your rooms every week
-make sure you are getting enough romance (it's a pretty high requirement)