Ah, I see we've discovered that yet another element of our EU membership has needed reconstituting after we've found life lacks a certain something after leaving.
Ho hum.
Ho hum.
Its more complex than that. The issue is that we are outside of the customs union, so building stuff outside and re-importing it (as in multiple factories specialising all over continental europe) becomes expensive in paper work, even though there may not be specific import taxes. Paper work in shipping takes time, money and a bunch of people to do, it makes everything much more expensive.
Even Bojo himself was ambivalent about the EU pre-2016, and famously wrote a pro-Leave and pro-Remain version of the same article before publicly announcing his position. It's pretty clear that he was motivated more by opportunism and personal advancement than by any strong belief in Brexit's merits.