Hey there! You're on the right track.
While working for the Queen you have an option to barge in on her while she's in the dungeon. Make sure you have leveled up enough to pass an education or perversion check. You'll ask her to let you help.
When you pursue this task again she will ask you to fetch something from her room. You'll be able to snoop through her drawers at this point to find the key.