Tax implication for a refinance (investment property)

Hello all, I have a tax question regarding rental property mortgage refinancing. 

From my understanding, many of the loan costs (loan origination costs, appraisal, credit report, etc.) are amortized over the life of the loan. If I refinance my existing loan with a new one, can I deduct all the loan origination costs from the existing loan the year I complete the refinance? 

Thank you.