This is another thing I fear, that causes me to do probably unnecessary rolls. I want the story/ gameplay to have at least some semblance of believability, so I don't want everyone risking their life on a curiosity because they know I won't kill them, but I also don't want to "punish" players every time they take a step off the walking path.
I'll admit it right here: sometimes I roll the dice just to give the illusion of risk, when in reality I'm buying time to make up the results of what someone just did.