Columbine served in the wars of Queen Anne under John Churchill, 1st Duke of Marlborough, and was for many years an officer of the 8th Regiment of Foot, in which corps he rose to the rank of major. He was subsequently promoted to the lieutenant-colonelcy of the 10th Regiment of Foot and performed the duty of commanding officer of the 10th upwards of twelve years, keeping the regiment in a high state of discipline and efficiency. He was promoted to the rank of major-general on 29 October 1735, and was rewarded with the colonelcy of his own regiment (later the 10th Foot) on 27 January 1737. On 2 July 1739 he was advanced to the rank of lieutenant-general.
