I feel like the mode icon on the leaderboard should be a button that also swaps between them. It took me a while to figure out that I can only view the leaderboard of the main menu mode I'm already in.

Yes, that's a good point. This was just the easiest way to implement it, but I agree that having to switch over the title screen is cumbersome. Definitely noted for next update.