Caves was formed by Lou Hanman (previously of Flamingo 50) after moving from Liverpool to Bristol, where Hanman met original drummer Dave Brent. After an initial lineup with Dave Brent's house mate Michael on bass, Jonathan Minto joined in 2010.[1]
They played Florida Punk festival The Fest for the first time in 2010 (the first of three years in a row). The same year they released their debut self-titled EP, and a four-way split 10-inch with Calvinball, Pure Graft, and Big City Plan. They recorded their debut album, Homeward Bound, in the beginning of 2011 and it was released in July of that year.[1]
In 2012 Caves toured with Pennsylvanian band Spraynard and Sundials.[1]
In 2013 their second album, Betterment, was released to acclaim that July.[1]
In 2014 they released third album Leaving, just eight songs and a total runtime of less than 20 minutes. That year Hanman moved to Philadelphia. The band continued to write long distance, and in 2017 they released a fourth album, Always Why.[2][1]
In late August and early September 2018, they supported Australian band Camp Cope on a partial UK and European tour.[3]
Hanman has also played in Philadelphia based bands Worriers and Katie Ellen, as well as being an occasional touring bassist for Olympia, Washington band RVIVR. Minto plays in Bristol based bands Dogeyed and Hell Maybe.[1]