The cash value growth of a permanent life insurance policy is tax-deferred1, which means you do not pay taxes on the growth of the cash value unless the money is withdrawn.Loans2 or withdrawals can be taken against the cash value of a permanent life insurance policy to help with expenses, such as college tuition or the down payment on a home. 1.