Born in Budapest, Kausz competed for Budapest Vasas Sports Club before moving to Budapest Progress and then finally moving to OSC in 1957 until 1970 when he retired. Kausz started out as a pentathlete, he would later just concentrate on the Épée form of fencing.[4]
Kausz was part of the Hungarian team that won the épée team gold at the 1959 World Fencing Championships, which was held in his home city of Budapest,[4] the following year he competed in the 1960 Summer Olympics. In the individual épée event, Kausz managed to get through three rounds before finishing last in his semi-final group, in the team épée, the team reached the semi-finals before losing to Great Britain and then lost to the Soviet Union team in the contest for the bronze medal.[5]
During his sporting years Kausz also managed to earn a degree in medicine and would later become a doctor for the Hungarian swimming team, and was part of the Hungarian Olympic medical team for six summer Olympics.[4]