There is a teleport stone in the first area with enemies, in the top right corner. It's deactivated at first, but after finishing the easy floor it activates. That's the teleport stone you need to use to get to the challenge floor.
Thanks! Seriously, thanks. I don't how many times my dumb ass ran by that orb.
