Before there was a 575 Madison Avenue May 28, 2015 by admin Looking North at the Fuller Building. Circa 1920. 575 Madison Avenue was still about 30 years or so from being built and Madison Avenue was a two-way street.