That is a legitimate fear, but almost never does a woman saying "no" to you mean she is rejecting you personally.
Would you feel rejected if you found out a girl was a lesbian, and not into guys? Why / why not?
Some girls aren't into guys, some girls just aren't into /u/plenty_of_eesh 's .
It's never personal.