Rayment was born in West Hartlepool, County Durham. His father, also called Joe, had played football for Hartlepools United in the 1920s.[1] Rayment began his football career as a youngster with First Division club Middlesbrough, while doing an electrical engineering apprenticeship at a local company. Having spent the 1951–52 season in the fourth team, and beginning the 1952–53 in the third eleven, Rayment made his first-team debut on 20 September 1952, at the age of 17, in a 4–1 defeat away to Liverpool.[3][4] Middlesbrough's manager suggested the club would be abandoning their policy of paying big transfer fees to concentrate instead on producing home-grown players,[5] and wanted Rayment to commit to the club as a full-time player, but his reluctance to abandon his apprenticeship prevented him from so doing.[1]
By the start of the 1954–55 season, new manager Bob Dennison reportedly had "great hopes" of the club's youngsters, Rayment included,[6] but his engineering employer sacked him for losing too much time to his football commitments. A company spokesman said that although staff participation in sport was encouraged, "there is a limit and he must make up his mind whether he wants to be one thing or another."[7] Rayment himself said he had tried to do his best for both parties, but because the apprenticeship was important to him,[7] he left Middlesbrough and joined Hartlepools United, where he was able to complete his final year with a local firm.[1]
His Hartlepools career was also interrupted by the requirement for National Service. Rayment served with a Royal Engineers bomb disposal squad based in Sussex, more than 300 miles (480 km) distant. He was able to appear for the club when military duties permitted.[1][8] Over three years with Hartlepools, he scored 17 goals from 65 matches in League and FA Cup,[9] and signed as a full-time professional for local rivals Darlington in 1958.[1]
In the inaugural season of the League Cup competition, Rayment made a significant contribution to Darlington reaching the third round, and coming close to taking First Division Bolton Wanderers to a replay. In the first round, Rayment scored the only goal of the first-round match against Crystal Palace after missing several chances.[10] In the next round they beat First Division club West Ham United 3–2: Rayment scored the second and debutant Lance Robson, then a dental student, the winner.[11] In front of a club record attendance of 21,023,[12] Rayment opened the scoring after 16 minutes of the third round, against Bolton, with what the Guardian's reporter called "a terrific shot", but the First Division side, with England international Nat Lofthouse at centre forward, came back to win 2–1 in the last seconds of the match.[13]
Rayment remained with Darlington for seven seasons. He scored 28 goals from 173 league appearances, all in the Fourth Division.[2] He finished his football career with a season at Gateshead, then playing in the North Regional League. He helped the club reach the second round proper of the 1965–66 FA Cup, in which they lost 4–0 at home to Hull City.[14]
After leaving football, Rayment spent eight years as an engineer in the Merchant Navy.[1] He was married three times.[1] He died in North Tees Hospital, Stockton, in July 2019 at the age of 84.[15][16]