There is a pit on the first floor that leads you to a puzzle room with a button above the mana shard slots. There are several solutions to this puzzle, and the cyan one leads you to the last orb.
Got it, thanks :3