(h) No by-law passed under this paragraph, as it read on the 31st day of July, 1983, that prohibits or regulates signs or other advertising devices, applies so as to require a sign or advertising device that is lawfully erected or displayed on the 1st day of August, 1983, but that does not comply with the by-law, to be made to comply with the by-law or to be removed by the owner or the owner of th