A native of Massachusetts, Pliny Fay was one of the first settlers in the town of Bloomington, later renamed Muscatine.[3] He joined his brother Edward here in 1837, a year after the town was surveyed and platted. The brothers were involved in the economic, political, and social life of the new town. They opened the second pharmacy in town and operated it together until Edward died in 1848. Pliny took on Frederick H. Stone as a partner, and they remained in business for at least another ten years. Adelia St. John was another New Englander who settled in Bloomington in its early years. She was the sister of William and Hamilton St. John, who were early land speculators in the area. She and Pliny were married in 1840.
The Fays become prosperous enough to buy this property on the bluff overlooking the Mississippi River in 1853. According to property tax records, the house was built the following year. Its architect and builder are unknown.[3] The house had to be moved from its original location sometime between 1866 and 1874 because of severe erosion along the bluff. Pliny and Adelia lived here with their two daughters and one son. The two daughters were married in 1867. Pliny's mother lived with them until her death in 1871. The Fay's sold the house in 1872 or 1873 and relocated to Santa Cruz, California for health reasons.