In exercising its power under this paragraph, the town board may, by eminent domain, remove or alter any buildings, structures or objects of natural growth which are contrary to the restrictions imposed in the area in which they are located, except railroad buildings, bridges or facilities other than telegraph, telephone and overhead signal system poles and wires.