Gizzo was born in New York City and was known as "Tony". In the early 1920s, after being arrested on a narcotics charge, Gizzo attempted to bribe a federal officer with $10,000 ($152,093 today). Gizzo was convicted and in 1924 served one year and a day at Leavenworth Federal Penitentiary in Leavenworth, Kansas.
Gizzo was a close friend of mobster Charles Binaggio. In 1930, Gizzo and Binaggio were arrested in Denver, Colorado, on a minor charge. During this time, both men were lieutenants to Kansas City North End political boss John Lazia in his illegal gambling operations. Gizzo soon became known as one of the five "Iron Men" due to his underworld clout. [citation needed]
In 1950, with Binaggio's murder, it is believed[by whom?] that Gizzo assumed leadership of the Kansas City family. [citation needed]