Ashby-de-la-Zouch has an historic 15th century castle which was formerly owned by the Hastings family. It was one of many sleighted by Cromwell's forces in the English Civil War. Underground passages run beneath its grounds. It is now managed by English Heritage.

Mary, Queen of Scots is said to have been temporarily kept in the castle. The castle area was the setting for Ivanhoe by Sir Walter Scott.