The 1st Earl's family and personal fortune was derived largely from mining on lands surrounding
Lambton Castle, the ancestral family home in
County Durham.
He was maternal grandson of the
4th Earl of Jersey and his wife, who was a mistress to the Prince of Wales, later
George IV.
Lord Durham's first marriage (
1812) was to Harriet Cholmondeley (d.
1815), allegedly a natural daughter of the
1st Marquess of Cholmondeley by his sometime mistress
Grace Dalrymple Elliott, although the
Prince of Wales also claimed paternity at her christening. Although from a good family, Grace Elliot was a notorious courtesan who lived for some time with
Philippe Égalité, the
Duc d'Orléans who voted for the execution of his cousin
Louis XVI. Durham and Harriet had three daughters who all died childless.
His second marriage (
1816) was to Lady Louisa Elizabeth Grey, eldest daughter of the Whig politician the
2nd Earl Grey, by whom he had 5 or 6 children. One of his daughters married another
Governor General of Canada, James Bruce, 8th Earl of Elgin and 12th Earl of Kincardine, who was later
Viceroy of India; their son the
9th Earl of Elgin also became
Viceroy of India, the only father and son to hold that office and position
1.
Another descendant, via his great-granddaughter Lady Lilian Lambton, was
Alec Douglas-Home. As 14th Earl of Home, he was the last British Prime Minister from the
House of Lords before he renounced his peerages to become a member of the
House of Commons.