Although his father hoped young Robert would pursue a career in law or banking, he instead intended to become an architect, and took drawing lessons from Robert Chanler and Everett Shinn. His father William Robertson Coe was not fond of the idea of his son becoming an architect, and, ultimately, Bob became a career diplomat.[2]
As a board member of the Planting Fields Foundation and Chairman of the Board between 1971 and 1985, he helped spark interest in the early restoration work at Coe Hall, particularly the Breakfast Room ("Buffalo Room") murals and the conservation of paintings and stained glass.[2]
Robert painted as a hobby, and never married. Coe died on May 26, 1985.[2]