To be fair: most folks don't really remember as many details as you think. Definitely not photo-level. I generally tell folks that you'll be able to draw a bird, sure. Even different kinds of birds - but they will be fairly generic and simple. You'll know it is a duck or goose or little bird or owl. But unless you've studied birds and drawn a lot of them, it won't be a blue jay, an exotic duck, a snowy owl, and so on. Not without a reference picture, of course.
Those reference photos are important enough that I had an art teacher that tasked us with taking reference photos with disposable cameras. This was mid-90s, before phones were everywhere and there were so many resources for such things.
I'll also add that I keep a dialog in my head as I draw. I can visualize well enough, but the 'thinking voice' come along and narrates the things I'm drawing. "Put that line there and go down and across the page...." "Just add that little window down there and remember the handle!"