Sadly, yes. The point is to capture other team's flag while defending yours and not just defending. Also yes, sometimes it becomes so frustating for those who attack and you just want to quit the game