The name is actually misleading because 12th century castles did not have gardens. The correct name should really be “the gardens in the place of the castle”. This is the site where the royal family of Hohenstaufen established its imperial castle in 1142. King Conrad III reigned over his kingdom from here, but was the only ruler who actually used Rothenburg Castle. As his sons died relatively early, the castle quickly lost its importance, but not before it had formed the seed for the germination of the town.
Starting from the castle, the settlement spread over the hill, until it had become one of the ten largest towns in the Holy Roman Empire by the year 1400, with a population of over 6,000. An earthquake destroyed the castle complex in 1356 and the stones of the ruins – a valuable commodity at the time – were used to build the city walls. Only the Chapel of St. Blaise was renovated after the quake. However this building was not originally a chapel, but rather the “Upper Ducal House”, probably the conference building where the king received his guests. The building was dedicated as a chapel after the renovation and now serves as a memorial to the fallen of the two World Wars. The Chapel of St. Blaise is also the site of the memorial to the pogrom of 1298, the original of which is in the Imperial Town Museum.