Rahman joined the CSE Department of the Bangladesh University of Engineering and Technology.[6] From 2000 to 2001, he was the head of the CSE Department.[6]
Rahman was one of the founders of United International University in 2003 after retiring from Bangladesh University of Engineering and Technology.[6] He was appointed pro-vice chancellor of United International University and served three terms.[6][9] In 2009, he was a visiting professor at the University of Bradford.[8]
From 2008 to 2022, Rahman was the vice chancellor of United International University.[6][10] He is an adviser to the board of trustees of United International University.[11] He was appointed vice-chancellor of State University of Bangladesh on 1 October 2023.[6]