Talk to Asara and select 'practice'. If battle minigame is on, it will show you the inventory and preparation screen. Select the map on the left (4th icon).
Stairs are marked clearly on the map. If you use them at least once, you can quickly change the floors in the upper right corner. To get to lvl 4 from level 2, you need to use the stairs at bottom left of the map.