Scott was elected as a Jacksonian to the Twenty-first Congress. He was an unsuccessful candidate for reelection to the Twenty-second Congress. He resumed his former business pursuits and retired from business in 1842. He died in Alexandria, Pennsylvania in 1850. He was interred in Alexandria Cemetery.
Scott married Agnes Irvine in 1821, Agnes is the namesake of Agnes Scott College in Decatur Georgia.