Vermiculite found in wall

I was ripping up lathe and discovered some vermiculite and it definitely got airborne and then I found another spot I didn’t mess with that one.

What are my options here there’s not a lot, should I shop vac it put it in the trash? Call someone?? Not sure what to do.