Shortly thereafter, the Freiherr von Strättligen settled in the castle. Portions of the current castle shield walls and main tower were built during the 12th century and by the 13th century the town of Spiez existed outside the castle walls.