He was about 2 or 3 years old when his family were ransacked by Communists during the Chinese Civil War and as a result, he decided to leave a few of his family members behind and came to Malaya with one of his brothers, uncles and relatives who were missionaries and were settled firstly in their adoptive hometown of Seremban, Negeri Sembilan, where he was domiciled even during his police career for citizenship purposes and later to be the site of his final resting place.
After arriving in Malaya, they later migrated and then settled in Ipoh and lived at the Cheng Elim Gospel Church on Taiping Road and studied at Nan Ying Hua School.
Although he and his family lived in poverty, he studied very hard in order to have a bright future and also works hard to earn extra money for a living prior to his police career.
Later, his aunt who completed higher education, arrived in Malaya and started working as a head nurse at the Negeri Sembilan Chinese Midwifery Home.
Therefore, when he was a student, Khoo would frequently rode his bicycle from Ipoh to Negeri Sembilan back and forth to visit his aunt.
When the Japanese invaded Malaya, his uncle instructed him and his brother to go south to Negeri Sembilan to seek help from his aunt and then he joined the Malayan People’s Anti-Japanese Army formed by the Communist Party of Malaya. After the war, his friends persuaded him to join the Communist Party of Malaya, but because of ideological differences between him and a few of his friends, he refused to become a member.
Assassination
On 13 November 1975, DCP Khoo was shot by two gunmen of the Communist Party of Malaya (CPM) on a motorcycle, at a line of traffic lights junction between Fair Park and Jalan Anderson in Ipoh, Perak. His driver, PC 5135 Yeung Peng Chong (promoted to Sergeant posthumously) was also killed when he returned fire at his assassins. After 28 hours, Khoo's condition worsened due to his gunshot wounds and later he died at the Ipoh General Hospital (or known as the Hospital Raja Permaisuri Bainun today) at the age of 50. After his assassination, his fellow colleague, DCP Dato' (later Tan Sri) Yuen Yuet Leng replaced him as Perak Chief Police Officer.
Two roads were named after him such as Jalan Khoo Chong Kong in Ipoh, Perak and Jalan Tan Sri Khoo Chong Kong at the Royal Malaysian Police quarters in Taman Desa Baiduri, Cheras, Selangor.