We actually tried that! As we mentioned in the post, even one kick is enough to ruin a game. The host can still kick someone who tries to report them as impostor. Or kick someone who they think is impostor, but people aren't voting for. Fewer kicks reduces how many people are affected, but not how bad it is to get kicked unfairly...