Feed the horse and Tricks will appear. Keep training the horse until the tricks are mastered (it will lower the horse's energy each time and you will need to keep feeding it).
The you can Take the horse and it will shorten your travel time. There is also at least one task that requires you have a mount with you.