Could this have been asbestos?

It may or may not have been asbestos, but the level in the air would have been no higher than what is naturally in the air (unless you disturbed the material and made a powder out of it in your hand). The biggest danger was being in the building itself. You can get really hurt or killed in a building like that.