Yes it really is infinit. It gets his infinity done by teleporting you seamingless back or forth (depending if you go a layer up or down) so you are really never leaving the Startingcube. And everytime you get teleported the Numbers just get changed accordingly like you said.
