Ergün completed primary, middle, and high school in Izmit. He graduated from the Marmara University's Faculty of Economics and Administrative Sciences in 1984.
During his high school and university education, he participated in several political and social activities. After finishing the university, Ergün worked in the fields of free trade, accounting, consultancy and management advisory services.
During the first Grand Ordinary Congress of the AKP held on 12 October 2003, he became a member of the Central Board for Management and Decision Taking of the party. He was re-elected to that position during the second Grand Ordinary Congress, held on 11 November 2006.
On 12 April 2005, Ergün was appointed as the deputy chairman responsible for local authorities of the Justice and Development Party. On 8 August 2007, he was elected as the acting chairman of his party's parliamentary group.
On 1 May 2009, Ergün became the Minister of Science, Industry and Technology in the second cabinet of Erdoğan. He was removed from office in a cabinet reshuffle on 25 December 2013.