Ahh ok, that makes sense. In that case I think adding some text like "I'd be better off doing this earlier/later in the day" when you do something at an incorrect time would help a lot!
There is no incorrect time.And if we add it then the game will be more predictable.We wanted player to think about it and make his own decisions.