The board based its decision on a city zoning ordinance which states a nonconforming building or structure shall not be added to or enlarged in any manner unless said building or structure, including addition and enlargements, is made to conform to all of the regulations of the district in which it is located.