While there is good debt and bad debt, debt is debt; whether deductible or not, the IRS will never credit your tax bill in the amount of interest owed (AFAIK; if someone knows of a loan whose interest is a credit instead of a deduction I am all ears).