As mayor, Church was strongly backed by the Toronto Telegram and opposed by the Toronto Daily Star. He was occasionally mocked in the pages of the Star by Ernest Hemingway who was, at the time, a reporter for the paper. Late in his career as an MP, Church denounced the newly formed United Nations as "modern tower of Babel", for "which Canada and Great Britain should not allow their interests to be the play thing."
In the House of Commons in June 1936, he protested against the requirement of bilingual banknotes in the Bank of Canada Act for banknotes to be introduced as the 1937 Series, stating there was no authority for it in the British North America Act, and that it had not been an issue during the 1935 federal election.[1] He favoured printing dual-language banknotes (distinct English and French banknotes) as had been done for the 1935 Series.[1] He was also a member of the Orange Order in Canada.