How it that IRS can charge interest for overdue taxes but don't get charged when they hold...?

They DON'T. If a refund you are due is delayed as a result of the IRS making an error, they ARE required to pay interest. A dispute over the amount due is NOT an error on their part, unless they DELIBERATELY miscalculate.