Learn how to handle rejection yourself. If you can’t take rejection well, you’ll tend to exaggerate how the other person will react to your rejection.
When’s the last time someone said no to you? Do you keep a tally of people that say no to you? Chances are you don’t know the last time someone said no. Same goes for every other human. People won’t remember your rejection a week from now. If they do, they’ve got problems that are beyond your responsibility and control.