The building has been home to many businesses over the years, most notably a restaurant in the 1940s-1950s called the Ham & Egger. Johnny Grant broadcast a live radio show from the restaurant where he interviewed such famous celebrities as Bob Hope, Jimmy Durante, and Alan Young. In the 1950s, Bernard Luggage Company moved into the building, and the owners purchased the building twenty years later.[2]
In the 2000s, when the city sought to develop the area into a W Hotel & Residences, the Herman Building's owner refused to sell. The city attempted to take the building by eminent domain, but lost their case. W Hotel was then built around Herman Building, which was reconstructed and restored to its original look.[2]