St. Peter's Church is the oldest English-speaking Anglican church in the Americas. A palmetto structure originally existed on the site. In 1619, a wooden structure was erected. This church was destroyed in a 1714 hurricane, after which a stone church was built. Major renovations occurred in the early 1800s (see Thomas Driver's illustrations from 1816), and a visiting bishop consecrated the church, giving it a proper name, in 1826.
The former site of a house, 20 Clarence Street, is now the Eastern Churchyard for St. Peter's Church (Anglican). Notable inhabitants include Humphrey Burchall, his son Jonathan Burchall the mariner, and the brewer Widow Ann Wright.