Very interesting concept! Maybe your planet can have a health bar and smaller meteors do less damage rather than triggering game over.