That's more protocol than anything. The IR used day-to-day was designed for consumer products in the 70s and 80s, so by necessity was a very simple protocol. There's no physical limitation for higher bandwidth IR.
https://en.wikipedia.org/wiki/Nyquist%E2%80%93Shannon_sampli...
IR has a frequency of between 430THz and 300GHz, so Max bandwidth would be between 215Tsymbols and 150Gsymbols (I used symbols instead of bits because I forgot the right term...)
So there is an information-theory limit, as I understand it. If I was ever wrong, this is the right crowd to find the person who will correct me!
And, ignoring other physical or 'current technology' limits, you can put as many bits in each symbol as you like.