Oh! Figured out what caused Always on Top to stop working, changing the monitor used breaks it(Switched to display 2 and then back to display 1).
Noted. Will try to fix.