And don't worry about gamepad. It was something on my side. Yesterday I was plugging in/out at different times (when game was on/off) and it didn't work but I tried it again now and it works.
Good to hear. And I forgot to mention, but the quests you were confused at (Philosophical Slime and the hidden room in the sewers) aren't accessible yet. Same with that rock on the left side of town. It's an arbitrary item, I haven't figured out what it's for.
