Hey Nanobytez,
I currently dont have an Xbox One Controller to test out but I'll look into what is causing the problem, hopefully its not a problem with your controller or adapter. Is it possible to connect the controller without the adapter? Just to try and rule out the source of the problem.
Thanks for the feedback, hope to help you out soon,
Rafi