On November 21, 1783, General George Washington wrote and delivered his farewell address at Rockingham, the former home of Berrien's father, which Berrien Jr. had inherited.[4]
Shortly thereafter, Berrien returned to Georgia with his family, but Margaret died in McIntosh County in 1785.[3]
In 1790, Berrien married a second time, to Williamina Sarah Moore (1771–1838), with whom he had seven more children:[5] Richard McAllister (1795), Ruth Lowndes (1798), Julia Maria (1801), Thomas, Sarah, Eliza and James Wemyss Moore (1807).[1] Thomas Berrien fought in the Creek War.[6] J. W. M. Moore was expelled from the United States Military Academy for his participation in the Christmas 1826 cadet mutiny, and in later life became a "great landowner" and commission merchant in Rome, George.[7]
Berrien was a member of Savannah's Christ Church. He was also an original member of the Society of Cincinnati, serving as president of the Georgia Society.[9] He was a member of Solomon's Lodge, the masonic lodge established by the colony of Georgia founder General James Oglethorpe.[3]