You get upgrades starting with the second level, but it's nothing that stays between runs.
If you want to focus on platforming, the small drones leave the level once the boss appears.
