I think I'd be mostly concerned about sawdust building up in the outlet and getting in the way of good electrical contact.

Semi-related story...About a year ago the headphone jack on my iPhone broke. I could plug in the headphones, but the plug wouldn't 'click' into the jack. It felt like the contacts inside had broken and were rattling around inside the jack. Took it to the Apple Store to see about getting it replaced, and the kid behind the counter checked it out, shining a light inside and probing with a toothpick. After a bit of poking and bumping the phone, he turned it upside down and dumped out a little pile of coarse sawdust. Turns out, when my phone was on my belt, the top of it it was getting bombarded with shavings and waste from the lathe, and that's where the headphone jack was waiting with its mouth open.    It has worked great ever since he cleaned it out and I started leaving the phone on the bench when I was turning.

Vaughn,

I have a Bluetooth adapter for my head set that uses that jack and I keep it plugged in to keep out dust.