To make the game not show up in the store/frontpage you need to go to the Project Setting on itch.io for your Game. Then you scroll down to Visibility & access, then click on Configure Settings and Mark the 2nd Checkbox called Unlisted in search & browse.