Charleville Mansion dates to the British colonial period, though details of its original construction are not well documented. Some accounts suggest it was built in the late 19th century (soon after the Indian Rebellion of 1857).[10] By the early 20th century it was used as a private residence. In October 1913, Victor Bayley, a British railway official who had just been appointed Assistant Secretary to the Railway Board in Shimla, and his wife took up residence at Charleville Mansion. Bayley’s family rented the house for the summer season of 1913, choosing it for its views and comparatively low rent (Shimla was the summer capital of India at that time).[11] Legends hold that after a few months the couple abandoned the house. Times of India travel writing recounts that Bayley and his wife "had to vacate it when they realised it was haunted".[12] The story goes that Bayley had heard rumors of a poltergeist in the house and decided to lock one upper room as a test. The next morning he found that room had been utterly destroyed and its contents scattered, with no explanation. Whether due to these frightening events or simply the end of the season, Bayley left Shimla later in 1913 and did not return. Thereafter, few people are recorded to have lived there for long periods; in subsequent decades it passed through private hands but remained largely vacant.[13]
After Indian independence in 1947, ownership of Charleville Mansion passed out of British hands. In the mid-20th century it came under Indian private ownership, and for many years was left mostly unused and derelict. Local accounts and later travel write-ups indicate the property lay abandoned and fell into disrepair through much of the late 20th century. The exact history of its owners in the post-colonial era is not well documented in published sources. In recent years the mansion has been acquired by an Indian owner and reportedly renovated, though it remains largely closed to the public.[14]