When Sherman came through Columbia, he spared three homes – the Lace House, the Caldwell-Boylston House, and this officers’ duplex. After the war, this building was converted into the governor’s mansion in 1868.