There is no way to move buildings once they've been built, but there is a way to move them. Open your build menu (hit e) and press either the delete key (don't hit backspace) on pc or fn+backspace on mac.
Any building that have been deleted are saved and are built instantly the next time you place its blueprint down.
Hit r to rotate blueprints.