In 1905, Georgetown, Josef Wharton owned a big estate out of town, but city management sent him a letter explaining that in order for the city to expand, Wharton must give up his home. After months of legal struggle, Wharton ultimately lost the lawsuit and his estate. The town further humiliated Wharton by giving him a small estate far from town. Josef was angry and swore that his family wouldn’t be uprooted from their new home.
Wharton decided to buy a small island close to Rhode Island, the island wasn’t considered valuable so Wharton got it for a low $200. Wharton moved to the island with his family and after the dedication and hard work put in by all the Wharton members, a three-story house rose out onto the rock. Wharton named it Clingstone House, as he would never again let his family’s house be taken from them.