I think you are right, if I develop the game further I am going to swap out the memes for more normal custom characters.
I used them because they were funny and a bit eye catching for a game jam, but for a non-gamejam game I don't think they would work very well :P
Thanks for the feedback! :)