What should I be looking for when buying an older house?

My husband and I are in the process of house hunting. This is in Central NY. So far the search has been depressing, but we cam across a home last week that we fell in love with. Nice lay out , large enough and within our price range. The house however was built in 1855. Talk about OLD. In CNY though, this is not uncommon. New siding however new plumbing new electric wiring, remodeling …etc. We will for sure have our own inspection, Radon, Asbestos, lead …etc. Its also septic system so will have that inspected to the fullest. My questions is , is this too old even for CNY, and what else should I be looking for?