To qualify for a Letter of Good Standing, all of the tax returns the corporation is responsible for must be filed and all taxes paid, including any penalties and interest, from the time the company was registered with the Utah Department of Commerce to do business in Utah.