I played a bit, and I think I found a bug? Basically, when I go gathering at the evening timeslot, instead of ending the day after the 3rd time gathering, it just let me roam around some more. The text when I try to gather again just says "0", I can gather as many times as I want, but as there's no manual way to exit the map (?), I'm just stuck there and have to reload a save file and had to redo the whole day.
One other thing, which is probably just my luck, is I got the thug event 2 days in a row, in said evening timeslots, and took some ingredients, then my 5 potions. Both things happened on the 1st and 2nd day and it just dampens my experience... Ouch.