If anyone is curious how i solved this nightmare, its pretty simple if you have probably ever used Vite for longer then a day
