Since you are familiar with SBCs, do you happen to know any other board with similar CPU and memory config but having RS232/RS485 Connections on them?
If you're willing to just breadboard it, or want to integrate it into something else, an FTDI chip + Maxim 1308x is basically what they're selling you, and I don't think they cost half that.