Any such securities as may be needed or desired by the company may be taken from said department at any time by replacing them with other securities equally acceptable to the Comptroller General, whose certificate for the same shall be furnished to the company.