Holten became a junior lieutenant in the Norwegian Life Regiment in 1790. In 1796, he moved to the Danish West Indies to join the West Indian Garrison.[2] He was then promoted through the ranks to colonel. In February 1807, he became a member of the Government Council on St. Thomas. On 14 February 1814, he was appointed as Governor of St. Thomas and St. John. He was later promoted through the ranks to first colonel lieutenant (2 May 1814) and colonel (28 October 1817). He was also appointed as chamberlain.[1]
On 1 April 1818, Holsten chose to resign. He was succeeded by Peter von Scholten. In early 1820 (11 February - 31 March), he briefly returned to the post as governor of the islands.[1]