Taylor House on Queen Street is one of the most photographed homes in St George’s and has been a favourite subject of artists for more than a century. The exact date of the building’s construction is uncertain, but it was standing when pilot Edward Colson had the lot granted to him in 1712. The grant of Seven Gables to the south mentions a garden belonging to Colson to the north of that lot in 1702, which suggests a house was close by. The early core of Taylor House is an L-shaped structure with a massive external chimney on the southern end, one storey over a cellar, all capped by a gable roof. As with the Old Rectory, timber-frame partitions survive inside, although in this building they remain buried beneath layers of plaster. From its granting until 1864, Taylor House was home to five generations of Colsons. In the 1770s the house was briefly the home of William and Sarah Sears when John Colson leased it to his daughter and sonin-law, but it reverted to his son Stephen after John’s death. Higher parish assessments suggest that by 1800 Stephen had added the cluster of rooms and chimneys on the west side of the old house, along with the two-storey portion at the extreme western end.

The house was apparently leased during the mid 19th century after the Colson family line died out. The Roberts family acquired the property in the 1890s and held it until Clifford Rowe purchased it in 1977. Rowe launched a much needed restoration which took five years to complete.