The position of Secretary for Education and Manpower was set up in 1983 when the old Education Department was restructured into the Education and Manpower Branch and Education Department, and the old position of Director of Education was split into SEM and Director of Education accordingly, with the latter reporting to the former.
Before the introduction of the POAS in July 2002, the SEM, as well as all other secretary-level positions, was a civil service position. The office holder was not a member of the ExCo. Before 1991, the office holders may be appointed by the Governor as ex officio member of the Legislative Council.
According to the proposal tabled by Donald Tsang's administration after he was re-elected as the Chief Executive, the manpower portfolio was transferred to the new Secretary for Labour and Welfare on 1 July 2007. The position of SEM was renamed Secretary for Education.