James Dutton, 1st Baron Sherborne

Lord Sherborne married Elizabeth, daughter of Wenman Coke and sister of the future Earl of Leicester, in 1774. They had four children:

• Elizabeth Jane Dutton (1775–1836), married Thomas Howard, 16th Earl of Suffolk.
• Anne Margaret Dutton (1776–1852)
• Frances Mary Dutton (1778–1807), married Prince Ivan Ivanovitch Bariatinski of Russia (1772–1825).,^[5] Russian Minister to the Court of Bavaria.^[6]
• John Dutton, 2nd Baron Sherborne (1779–1862), married Mary Bilson Legge (1780–1864), daughter of Henry Bilson Legge, 2nd Baron Stawell (1757–1820).

Lord Sherborne died in May 1820, aged 75, and was succeeded in the barony by his son, John. Lady Sherborne died in December 1824.

His obituary, from the July - December 1820 New Monthly Magazine and Universal Register states:

Never within the memory of man has death swept with a more devastating and unsparing hand amongst the noble houses of our land, than within the last two years - the rich and powerful have been humbled amidst the very plenitude of earthly enjoyment, and silently laid in a lowly place of rest...But amidst them all, there is none whose death will be more truly lamented than that of Lord Sherborne. This mournful event took place on Monday evening, May 22, at eight o'clock. His lordship had been seriously indisposed for some time past, but, we believe, no idea of immediate danger was entertained. Distinguished through a long and honourable life by the exercise of every generous and noble quality that could adorn the heart of man, Lord Sherborne enjoyed, in unbounded good will, the respect, the esteem and the affectionate regard of all to whom the many excellent traits of his nature were known. Possessing an extensive property, his first pride was the character with which the gratitude of his tenantry invested him; and to be known as "a good landlord" was to him the chief gratification derived from his possessions. When the honours of this world have passed away, and are forgotten, the record of his Christian zeal, of his piety, and of his benevolence, will be greeted with a sacred enthusiasm, and a mournful reverence inseparable from the memory of his worth.^[7]