On January 8, 1979, Ray was appointed by the District of Columbia Democratic State Committee to the at-large council seat vacated by Marion Barry, who had been sworn in as mayor a few days earlier.[5] He was Barry's chosen successor. Ray went on to win the May 1 special election handily[6] and then to be reelected in 1980, 1984, 1988, and 1992.[2]
Following Council Chairman John A. Wilson's suicide in May 1993, the council chose Ray to be acting chairman.[7] Mayor Sharon Pratt Kelly had backed another at-large council member, Linda Cropp, for the appointment and thought she had lined up the votes on the council, but Charlene Drew Jarvis switched her vote to Ray[8] because she intended to run for chairman in the special election and viewed Cropp as a threat.[7] Ray served as acting chairman until the special election on September 14, which was won by former chairman David A. Clarke.[9] Ray finished his term as at-large member, but he did not run for reelection in 1996.[2]