Mark and I discussed this as we walked a slightly remote area today and realized that if either of us were in the location solo, these stories can creep into your head and take away from the enjoyment of being out.
I always felt more comfortable the further out I got, figuring I'd see less people....until I turned a bend one day, about a mile into the woods and there was a scroungy looking fella standing in the middle of the path. I didn't even have my dog with me and had not shared my destination with anyone. It's the ONLY time that I have ever felt uneasy or vulnerable while alone in the forest. I've made some adjustments since that day.
.... I smiled and nodded as we passed each other. I got about 20 feet away and pulled out my cell phone and acted as if I was answering a call, discussing where I was and what I was doing. I never turned around, just kept walking and "talking on my phone".