This diagram shows the fetal development of a horse foot.
So, modern horses have vestigial extra toes, which are too small to be easily noticed. Occasionally an unusual horse is born. For example, according to the historian Suetonius,
[Julius Caesar] used to ride a remarkable horse, which had feet that were almost human, the hooves being cleft like toes.