What to look for in old houses

My husband and I are looking for a new primary residence for ourselves. We are going today to look at a house that was built in 1904. It has a new water heater, furnace, roof, and electrical wiring. 

For those of you that have bought and/or looked at older homes, what are some things we should look out for? 

Thanks!