Instead, I'll employ a damp watercolor brush, moistened toothpick, barely wet sponge tool (or even a finger) to gently and patiently wipe the offending blemish away. The important thing to remember when using this technique is that any amount of moisture - no matter how slight - will rehydrate the clay to some extent, which is what we wanted in the first place of course, but which can also cause the clay to be more fragile than we might realize.
It's important to be aware of where you're placing your fingers, how much pressure you're using, and to always let one repair job dry completely (even if only for 30 seconds) before you start working in another area. Placing a mini dehydrator or cup warmer nearby will help speed the drying process.
Just the merest hint of moisture (true confession - I use saliva, which is not as wet as water) will be enough to get the job done. Always tamp a wet tool on your wrist to remove excess water before using a 'wipe' motion to smooth or fill the clay (getting in the habit of using silva when working with fine silver was okay in my book, but I have to retrain myself with the advent of base metal clays).
When wet/finger sanding, (or as I call it - controlled rehydration) you're effectively taking material off of one area and immediately depositing it in another to fill a slight gap, pit or scratch; smooth a bumpy surface, or remove unwanted texture marks. When turning to a harsher file is not the best alternative, give controlled rehydration a try. Let me know how it works for you.