Do i have to move due to asbestos?

I used to work for a carpenter and he let me rent his house which needed lots of work. He took a wall/closet out that was in between the kitchen and living room, and tons of stuff from the ceiling fell down, and theres a big pile of it there now. Just tonight i was shoveling it into a garbage can and taking it out, but dust is on everything in my living room and kitchen. What the heck do i do? Even if i got it all shoveled out, do i have to throw away everything with the dust on it? And will the dangerous dust ever leave the house even with vaccuuming? Please help, thanks! Oh yeah, forgot to mention... my old boss and landlord that was doing it suddenly got way to busy and left it like that and wont be back till winter.