Kastor was born in 1895 as the youngest of four children to Mr. and Mrs. I. Kastor. He attended schools in Evanston, Wyoming. He graduated from high school, as well as a business college in Boston.
Career
Prior to entering politics, Kastor worked with his father in the clothing business for a number of years.