I thought a lot about this the last few days, and you bring up some good points. Here's what I'm thinking:
- Ratings are very niche on Itch right now. You can only see them one view (Top Rated), and they're going to be revamped soon anyway.
- It's imperative to rate honestly (to not create a voting ring/gang). Therefore, it's better to rate something good (if you like it), or not to rate it at all if you don't (unless we have 3-4+ people rating each game).
- Feedback is more valuable to developers anyway; especially if they want feedback on specific things (eg. a specific mechanic, a specific level or weapon).
- As you brought up, it's better to let people submit their/others' games than to randomly pick something.
What I had in mind is that a few people submit games, and a few people pick/critique whatever games from that list they find interesting. I think this would avoid most of the problems above, but still be useful for game developers.
What do you think?
There's also a list of developers on Twitter asking for feedback on their Itch games. We can engage them, and/or use that as the list of games to rate to start. Maybe.