At Norfolk Island he was employed correcting a previous survey which had been made without proper instruments, and he also undertook some of the administrative work. Grimes returned to Sydney in April 1794 and with the surveyor-general Augustus Alt being in bad health, he was required to take over most of Alt's work. In February 1795 he sailed north in the Francis and spent approximately one week at Port Stephens and reported unfavourably on the locality.
Grimes is responsible for fully surveying the Hunter River in November 1801 with Francis Barrallier. In late 1802 Grimes commenced a survey of King Island and Port Phillip with Charles Robbins in Cumberland. On 30 January 1803, whilst on his survey of Port Phillip he and his party landed at Frankston where he met around thirty Indigenous people. On 2 February 1803 he reached the mouth of the Yarra River. Next day Grimes ascended the river in a boat and explored what is now the Maribyrnong River for several miles. Returning to the Yarra it was explored for several miles but the boat was stopped by Dights Falls. The journal of another member of the party, James Flemming, has been preserved,[1] and in it he several times refers to finding good soil. Although it was evidently a dry season Flemming, who was described by King as "very intelligent", thought from the appearance of the herbage that "there is not often so great a scarcity of water as at present". He suggested that the "most eligible place for a settlement I have seen is on the Freshwater (Yarra) River". A plaque at the site marks the event. Grimes returned to Sydney on 7 March 1803 and, in spite of Flemming's opinions, reported adversely against a settlement at Port Phillip.
Some accounts state that Grimes acquired a block of land in Sydney from Robert Ryan. The land was a grant of 120 acres (0.49 km2) which comprised effectively the entire modern suburb of Kirribilli. Grimes sold the land to Robert Campbell in about 1806.[2]
Grimes obtained leave of absence and went to England in August 1803. It was nearly three years before he was back in Sydney. In March 1807 he was sent to Port Dalrymple, and using the advice of Thomas Laycock, who a month earlier had become the first European to traverse the interior of Tasmania, Grimes made a survey of the district and examined the route to Hobart. Much of the route he surveyed became the Hobart Road, and many sections of the original 1808 road still form part of the Midland Highway.
Grimes returned at the end of the year, and became involved in the deposition of Governor William Bligh in the Rum Rebellion on 26 January 1808. He was one of the members of a committee formed to examine the administration of Bligh, and was appointed acting judge-advocate. In this capacity, he sat at the token trial of John Macarthur. Grimes realised, however, that his lack of legal training made it difficult for him to act effectively in his judicial position and he resigned on 5 April 1808. He was sent to England with dispatches that same month.