It's based on the number of invasions you have when you prestige (you need several invasions before the first golden flag).
