In Guyana he encouraged the development of a Third Order of Saint Francis within the Anglican church based on the work by Emily Marshall. She was his sister-in-law and she had been an assistant from when he was in Sunderland.[10] Swaby's archdeacon Fortunato Pietro Luigi Josa published St. Francis of Assisi and the Third Order in the Anglo-Catholic Church in 1898 in England quoting text from the order's founder but without naming her. The idea grew[10] and when Swaby was Translated to Barbados and the Windward Islands in December 1899[11]/1900 then the new order quickly took hold.[10]
Swaby held the two separate Sees of Barbados and of the Windward Islands together.[12] He died in post in 1916.