Hesitation and fear are the number one enemies of new street photographers. The reality of it is you can shoot just fine and not worry about it, but that only comes with time and experience.
Another part of it is learning to read the subtleties of the atmosphere and your potential subjects to know when and when not to take a photo. Some people very obviously should not be photographed, some you should ask permission, most you can just fire away. These days I don't even think about it unless the picture I want is quickly approaching Bruce Gilden levels of in-your-face shooting, which I rarely do.
Street is one of the most difficult forms of photography even for the experienced photographer. Adding the fear on top of it really hinders people.