Active in the Social Democratic Party, he was in the municipal parliament of Lausanne (1934–1946), member of the parliament of the canton of Vaud (1937–1946), mayor of Lausanne (1946–1949), member of the National Council (1942–1969, except 1963), he was the Speaker of that Assembly from 1965/66, he sat in the Foreign affairs committee and was deputy chairman of the enquiry parliamentary committee dealing with the Mirage affair.
He was also a member of the government of the canton of Vaud (1962–1970) in charge of the Finance Department. He served as one of the four members of the Commission to resolve the problem of the Jura.
He was elected to the Swiss Federal Council on 10 December 1969. During his time in office, he headed the Political Department, i.e. ministry of foreign affairs. Graber was President of the Confederation in 1975 and handed over office on 31 January 1978. During his term of office, a new law for Cooperation Development was adopted.
On 1 August 1975, he signed the Helsinki Final Act of the CSCE on behalf of Switzerland. At his initiative, Switzerland recognized North Vietnam and North Korea. Graber presided over the diplomatic conference that led to the adoption of the additional protocols to the Geneva Conventions in 1977.