Born in London, Hornidge left school before the age of nine.[2] In 1876 he became a laster, joining the National Union of Boot and Shoe Riveters and Finishers (NUBSRF), and serving on its London branch committee.[2] However, he struggled to find work an, in search of employment, he moved to Northampton. He became President of its local branch in 1891 and, two years later, was elected General President of the national union. He was known for his commitment to liberalism, and focussed on arbitration as a solution to industrial disputes. He was also active in the National Secular Society.[3]