Equip a weapon that you can use on a horse, such as a bow. Then, buy a horse. You can now just switch to any weapon desired when you are on the horse.