Admittedly a bit hard to see but the rope you are hanging from is slowly tearing over time. When it breaks completely the game is over.
