He was the father of trainer David A. Boyle and of the World War I soldier, adventurer and businessman Joseph W. Boyle, known as Klondike Joe Boyle.[3]
In 1871, Boyle and his family have moved to Woodstock, Ontario, a residence he would maintain for the rest of his life. Charles and wife Martha are buried in the Woodstock Presbyterian Cemetery along with their son Joseph, who died in 1923. Joseph was originally buried in England but his remains were brought back to Woodstock in 1983 to be interred with his parents.[4][5]