Think about it this way: You can control pretty much two things in life - Your own actions, and how you react to other people's actions. Getting all worked up over shit you can't control (other people's actions) wastes time, energy, and happiness.
Imagining someone else's reaction to your decisions is basically creating expectations of others. And expectations are nothing more than preconceived resentments.