Right, agreed. I basically just said that last part to someone else.
The problem with seeing danger in every shadow is that you'll never feel safe is safe enough. There is only so much a person can do to protect themselves, but there comes a point where you've made everything so inconvenient for the sake of security that you can't just live your life. Take reasonable steps and don't worry beyond that.