"The 20-day period shall not be tolled by the agency except in the following cases." . . . .