His art collection, which initially included 300 works—mainly etchings by Western European and Russian painters of the 19th century, as well as paintings, sculptures, and graphics by Estonian artists (August Weizenberg, Kristjan Raud, Eduard Wiiralt, Paul Burman, Aleksander Vardi, and Ferdi Sannamees [et])—was founded by his mother Selma Lepp (1911–1977).[8][9] Lepp started collecting graphics in 1961, and in 1972 he started focusing on Estonian painting. The collection also includes watercolors, drawings, and sketches. He has held a series of exhibitions of his collection and published folder series, catalogs, and bibliophile publications. Lepp has also written books on botany.
Very large collections have developed for the most important artists in the overall collection. There are over a thousand works by individual artists. Large collections by several individual artists in Lepp's collection include the works of Aleksander Vardi, Jüri Arrak, Valdur Ohakas, Olav Maran, Olga Terri [et], Vive Tolli, Peeter Mudist, Richard Kaljo [et], Felix Randel [et], Johannes Uiga [et], Johannes Saal [et], Elmar Kits, and Eduard Ole.