The board shall appoint a secretary, who shall be exempt from the civil service law, who shall be sworn to the faithful performance of the duties of his office, and who shall keep a record of all proceedings, issue all notices and attest such papers and orders as said board shall direct.