The home was designed in the French Beaux-Arts style by architect Horace Trumbauer of Philadelphia and constructed in 1906[1] for financier George Jay Gould, the eldest son of railroad magnate Jay Gould. It replaced the Neo-Gothic style Jay Gould House, which was demolished. The new house was designed both to complement and outshine the Isaac Stern House next door, at 858 Fifth Avenue.