Hsu was raised in southern Taiwan and joined his school baseball team in elementary school. At the age of 12, Hsu participated in the 1989 Little League World Series while playing for Kang-Tu Little League. Kang-Tu lost the series to a team from Trumbull, Connecticut.
In 2000, he joined the Seibu Lions of the Pacific League in Japan. In 2012, after 12 seasons with the Lions, he moved to the Orix Buffaloes, where he played 2 seasons.