I have the exact same problem. They just aren't a great fit. I walk my dogs every night for 1 hour and enjoy listening to podcasts during this time. I tried some Mopow bluetooth earbuds but they weren't any better. I'm considering some large headphones this holiday season.
On a lighter note, I live in Canada so for 6 months of the year, my toque holds the Apple earbuds in my ears.