I may be mistaken but does horse racing come from Jousting. I mean the silks they wear seem to resemble the knight's colourful garments. The sash, the diamond patterns and stripes and so on.
So I was thinking couldn't they have one race at the end of the card in original knight regalia ? full armour and the fancy costume over the horses.