The slow starting ship speed is intentional, you must use reactors ship parts (also your very first part in the game) to move faster, a reactor must be opposed to the direction you move to give you a speed boost
Yeah I think it's a fun player decision every time you get a booster, "Do I want to go faster forward, or give myself better maneuverability by putting it in a different direction. If so, which direction?"
