He married three times. He was first married to (Ann) Moireen Campbell in 1948. They had two sons and two daughters, one of his granddaughters being Alice Warrender (born 1983), a former investment manager who became a devout Catholic writer, painter and artist following a radical conversion. She died in 1976, and he remarried, to Shirley Crawley (née Ross), in 1977. His second wife died in 1981, and he remarried again, to Jan Graham (née Joanna Kathleen Chancellor), in 1985. He died in Edinburgh.
His heir was his son, Michael (b. 9 January 1949), who became the 3rd Baron. He is married and has a son, John Michael Patrick Caspar Warrender (b. 1 June 1996).