Rather than pull away, consider asking more questions what is going on with your partner or other person.
Think in terms of how can I make it safe for my partner? Take time to share what your feeling so they don't make up a story.
When you are feeling mistrusting, tell your partner what you are afraid of. (hint: this may require a lot of reflection initially)