Bullock was elected as a Federalist to the Fifth Congress, serving from March 4, 1797 to March 3, 1799. He was judge of the Court of Common Pleas for Bristol County and from 1803 to 1805 was a member of the Governor's council. He died in Rehoboth; interment was in Burial Place Hill.