check out the floor to see fi there is any water damage. if there is, fix it asap. also, discuss with your plumber what the cause is. it almost sounds like there may have been a significant issue the tenants were hiding.
you should probably consider regular inspections as well. if you were doing inspections this stuff should have come up.
Join the Largest Real Estate Investing Community
Basic membership is free, forever.