I finally finished all the little delivery quests of taking a horse from the stable master and delivering to three different stables all across the map, then finished his little race around the property in under two minutes. All of that for the privilege of earning my riding skill and paying 4 gold pieces for a horse.
It was sure worth it though, I can’t believe how fast I can get across the maps now. The only downside is that I collect less ore and wood on the way since I have to dismount to do that. I’m now walking around the northern Bree-lands grinding for medium hides so that I can master my Journeyman Tailor crafting skill.