The museum was built in 1927. Hattie Bishop Speed established the museum in memorial of her husband James Breckenridge Speed, a prominent Louisville businessman, art collector, and philanthropist. Ms. Speed set up the endowment to fund the museum, encouraging the museum to never charge admission.
The Speed houses ancient, classical, and modern art from around the world. The focus of the collection is Western art, from antiquity to the present day.