The Kentucky Derby still draws huge audiences and betting handles even as the sport of horse racing faces grave challenges.

This sprawling 7-bed, 11-bath, 12,000-square-foot, federal-style estate near Louisville was originally built in 1790, with ...