Shumate began his coaching career at Rockwood High School in Rockwood, Tennessee. In three seasons, his teams compiled a 71–19 record. He then moved to nearby Harriman High School, where he had a 10–16 record in his only season as head coach. Shumate returned to Tennessee Tech to earn his master's degree, then resumed his coaching career at Niceville High School in Niceville, Florida in 1969. His assistant was future college basketball head coach Cliff Ellis.[5]
In 1970, Shumate became an assistant to Leon Ford at Chattanooga. He was promoted to head coach in 1972.[3] Over seven seasons, Shumate's teams had an 139–61 record and appeared in the NCAA Division II men's basketball tournament four times. Chattanooga was runner-up in the 1976 NCAA Division II basketball tournament and won the 1977 NCAA Division II basketball tournament. He was named NABC Division II Coach of the Year in 1977.[6] In 1977, Chattanooga moved from Division II to Division I.[7] Shumate resigned in 1979, citing mental and physical exhaustion.[2] His 139 wins rank third all-time at Chattanooga and his .695 winning percentage is second only to Murray Arnold.[6]
Shumate returned to coaching in 1981 as the head coach at Southeast Missouri State.[8] He led SEMO to seven Mid-America Intercollegiate Athletics Association championships (1982, 1983, 1985, 1986, 1988, 1989, and 1990) and two appearances in the NCAA Division II national championship game (1986 and 1989). In 1988, Shumate was named NCAA Division II National Coach of the Year by Basketball Times. In 1991, SEMO moved from Division II to Division I.[9] The Indians struggled at the Division I level, going 71–95 in their first six seasons. Shumate was fired on May 15, 1997 amid a NCAA investigation.[10] Shumate is the winningest men's basketball coach in SEMO history with an overall record of 306-171.[9]
Shumate remained out of coaching until 2004, when he became the head boy's basketball coach at Soddy Daisy High School in Soddy-Daisy, Tennessee.[11] He amassed a 57-36 record over three seasons before retiring.[12]