Dibra was born in Tirana into an intellectual family as the only brother among three sisters, and attended the Alqi Kondi School before enrolling at the Qemal Stafa High School. While at the Alqi Kondi School he was a successful athlete, competing in the 60m and 100m where he was schoolboy champion at the time. He began playing football near his home where former 17 Nëntori Tirana player Aurel Verria would train youngsters. He was also a member of the Pallati i Pionerëve team that won the Durrës pioneers tournament under the guidance of coach Osman Reçi. At the age of 15 he rejoined 17 Nëntori Tirana's youth team, where the coach Xhavit Demneri recognised Dibra's pace and played him on the right wing and up front.[2]
Dibra first joined the senior side in 1970 following a traditional preseason internal friendly between the 17 Nëntori first team and youth team, in which Dibra scored twice to win the game for the youth team. After the game the 17-year-old was told by the first team coach Myslym Alla to bring his boots for the season opener against Tomori Berat, where he came on in the second half to make his debut following an injury to Ali Mema. He became the Kategoria Superiore's top goalscorer alongside Agim Murati in 1979, both scoring 14 goals.[3]