Heinrich Lossow's father was Arnold Hermann Lossow, a Bremen sculptor. His father moved to Munich in 1820 to study under Ernst Mayer. In Munich, Arnold Hermann Lossow married and had three children: Carl Lossow in 1835, Friedrich Lossow in 1837, and Heinrich Lossow in 1843. The three boys had an affinity for art; Carl became a historical painter, while Friedrich became a wildlife painter. Heinrich would outlive both his siblings.