Powers and duties of heads of departments. - Each head of department of the city government shall be in control of such department, under the supervision and control of the Mayor and shall possess such powers as may be prescribed herein or by ordinance.