Pooles Island was first occupied by Native Americans. The shell middens on the island were evidence of their presence. It was first sighted by Europeans in 1608 when Captain John Smith explored the Chesapeake. He named it after Nathanial Powell, a member of his party. Over the years the name evolved from "Powell's Island" to "Poole's Island".[citation needed]
In 1855, two watermen, Capt. Elijah Williams and Capt. James Williams, were lost in a storm. Capt. Elijah Williams' body washed ashore on the island, while his older brother James' body was never found; Elijah was buried by the lighthouse keeper.[citation needed]