Yup. Power-ups and potions exists in chests and drops. Enemies get progressively stronger with every floor so you'll be needing them.