In 2001, when she was just 24 she was elected to the Folketing, representing the Copenhagen County constituency as candidate for the Conservative Party in the Hellerup nomination district. After serving until 2006, in 2007 she was re-elected representing the Conservative Party in the Greater Copenhagen constituency as candidate for the Lyngby nomination district. She served until 2011. Her final term at the Folketing was from January 2014 until June 2015 when she again represented the Conservative Party in the Greater Copenhagen constituency.[4]
Her parliamentary responsibilities included chair of the Education Committee and vice-chair of the Social Services Committee (2001–05). She served as spokeswoman on areas including social affairs (2001–05), family policy (2004–05), education (2006–11) and ecclesiastical affairs (2005–11 and 2014–15).[4]
As a child, Dyremose was not particularly religious although she was brought up in a Christian family. It was first in connection with her confirmation that she became more interested in the importance of faith. Christianity went on to play an important part in her political life. It was therefore not difficult for her to turn from politics to religion.[1]
In June 2019, Dyremose was ordained in Helsingør Cathedral and became a parish priest in Ganløse.[2] After a period at Bistrup Church in the north of Zealand, as of December 2023 she is attached to Hellerup Church, just north of Copenhagen.[1]