The library was founded by a bequest of Mary Louisa Armitt in order that the intellectual activity of Ambleside could be celebrated. The roots of the organisation go back to the Ambleside Book Society which was founded in 1828 and which formed part of the library.[3] On 8 November 1912 the library opened and Hardwicke Rawnsley who was to co-found the National Trust wrote a poem in celebration. The poem starts:
As in some inland solitude a shell Still gently whispers of its home, the deep, So from the world of being beyond all sleep Where those two happy sister spirits dwell...
Beatrix Potter donated books and paintings in her lifetime, and on her death bequeathed her portfolios of natural history watercolours and her personal copies of her "little books". These are on permanent display in an exhibition Beatrix Potter: Image and Reality.
The current building was constructed in 1997 from slate and stone on the land belonging to St Martin's College (formerly Charlotte Mason College).[3]
The Armitt also houses a collection of works by Kurt Schwitters,[2] a German refugee artist who lived and died in Ambleside.