How long do you have to be exposed to asbestos for it to have a negative effect on your health?

If I was in a derelict house for about 20 minutes where I suspect there may have been asbestos particles in the air from holes in the walls, what are my chances of suffering from asbestosis, etc? Could this be fatal or do you have to have long exposure to the asbestos for it to make you ill?