I see what the problem was. If you don't kill that ghost that gives you the blue flame, then the skeleton door won't turn on letting you pass.
The game should at least give you a hint about this... x_x