He was the only son of William, Lord Ferrers by his father's first marriage to Margaret Uford, daughter of Robert d'Ufford, Earl of Suffolk and Margaret Norwich.[2] He was born in Tilty Abbey, Essex on 6 February 1356, and baptised in nearby Stebbing[3] Whilst still a minor, in the words of the family's most recent biographer, he "fell prey to the fraudulent schemes of his father's feoffees", who attempted to dispossess Henry of certain Essex and Warwickshire estates.[2] Two of his father's feoffees, a clerk called Edmund de Stebbing and one Robert de Bradenham attempted to use a forged release, which would allow them to take the manors into their own hands.[3] At some point, but certainly before 27 June 1371 he married Joan, possibly the daughter of Sir Thomas de Hoo of Luton Hoo;[4] they had one son, his heir William, who had been born on 25 April 1372 in Hoo, Bedfordshire.[2]