As someone currently doing this: I miss nothing. Walmart offers free 2-day shipping on most goods I would typically order from Amazon, and often cheaper. Best Buy has whatever tech thing I want, I get it same-day, and price-matched at Amazon, and I know it isn't counterfeit. Most book publishers (my original reason for using Amazon) have long ditched the platform and directed me towards ordering direct from them which usually nets me reduced price/shipping. Apple music is better than Amazon Music. Audible is separate anyways, having Prime didn't help me out much there. Netflix is better than Amazon streaming, and so on.
The biggest benefit so far? I am generally ordering less stuff overall. I felt like I had to order x amount of stuff to make my prime membership "worth it", but it was never "worth it". It just resulted in me spending more money with Amazon, even if I had better alternatives around me.