I tested it and it does really seem like its linked to adaptive sync. When I turned that off the game ran fine and didn't have any flickering or weirdness.
