This seems to be the fastest way to earn material. Try to work for the character until fullfilling their affinity. You can gain material while unlocking cg. Also, get the best gears especially the weapon as soon as possible.
By the way, I think the taughest parts are gaining vegetables and diamonds at the early stage. Get through it and things will get smooth. :p