This is one of those things you just have to try and see if it works. I've quit caffeine completely for a few weeks, and didn't notice a difference in my sleep quality.
I’ve been off caffeine for a year or more. Having it actually makes my stomach slightly upset now. Similar to sugary drinks - I can’t do them anymore. Once I gave them up - I couldn’t go back.