I personally think people overstate the difficulty. If I decide to start a project without carrying over my previous code, it only usually takes me around three weeks to get it to a nice state, which is very little compared to making the rest of the game itself.
In my current project, just modelling my overworld has taken me almost a year at this point.