I went skiing for the first time in my life recently, and even there I had a substantial fear around looking like an idiot, despite the fact there should be no expectation I would be any good at the sport, in fact I should be quite bad. It didn't stop me from doing it, but it did mean I needed to spend conscious and concerted effort reminding myself that it's okay to be bad at something when you're learning.
Engineering and asking questions is no different.
EDIT: a necessary addendum to this is that it's important to be cognizant of the time of the person answering the question. If you find yourself asking the same question repeatedly, or asking questions that were addressed by resources you had previously been directed to, or asking investigatory questions that would require the answerer to do your research for you, you may require a bit of self-reflection.