Yeah, I definitely see how using multiple box colliders for the player will be hard to fit in the 3 hours ^^Maybe a quick workaround would have been to reduce the enemy collider and make the friendly one bigger (but maybe you did that already..)
I did actually try that but then reverted as it felt too easy :D My bad