There is actually an item that allows you to pass through a window, i believe it is called a glass cutter, i recieved 3 from a quest
