He was born in Frederick in the Province of Maryland to Johann Adam Schieffe, a cobbler, and his wife Magdelena Loehr of Südwestpfalz, Germany. They had immigrated to the Province of Maryland about 1764. Largely self-educated, Sheffey pursued classical studies. Apprenticed as a shoemaker in his father's shop, he spent his leisure hours observing nature and the mysteries of astronomy; upon attaining his majority, he walked to Winchester, Virginia and began plying his trade until he built up his resources. He moved to Wytheville, Virginia, in 1791.
He worked at his trade, all the while he attained a reputation for quick wit and immense intellect. Finally, he was received as a student into the office of Alexander Smyth, Esq. an eminent lawyer in that part of the state, and afterwards commander of the northern army during the War of 1812.
He was admitted to the bar July 1, 1802, and commenced the practice of his profession in Wytheville.
He moved to Staunton, Virginia where he continued the practice of law.
He served as member of the Virginia State House of Delegates 1800–1804.
He served in the Virginia State senate, 1804–1808.
Sheffey was elected as a Federalist to the Eleventh and to the three succeeding Congresses (March 4, 1809 – March 3, 1817).
On January 30, 1812, he married Maria Hanson, the daughter of Lt. Col. Samuel Hanson of Mulberry Grove, Maryland and great-niece to John Hanson, President of the Continental Congress. In 1814, Sheffey was elected a member of the American Antiquarian Society.[1] He was again a member of the Virginia State House of Delegates in 1822 and 1823.
