I find myself gifted in being able to have wild lucid dreams and remembering details, and even learning! I also have nightmares that I can't wake up from and they're terrifying. I often know it's a dream (or is it?) and can't wake up. You're missing out on a lot of fun, but you're also not tormented. If you want to remember your dreams, smoke less weed and concentrate on that blurry moment of going from awake to asleep. Our dreams are in the REM barely-asleep part of the sine wave.
I don’t do much lucid dreaming but agree with the last point. It’s why I find it hard to get up early in the morning sometimes. I know if I keep sleeping and waking up in short chunks that I’m going to get a lot more dream time in and I enjoy most of them.