the work of contract personnel; Manages and coordinates internal and external technical resources to ensure that hardware, software, and data communications networks meet specification determined by users, vendors, and external authorities; Coordinates or directs monitoring and evaluation of departmental and contracted services including the development of designs, criteria and procedures; Recomm