The European Union does not have a trade deal with Japan (https://en.wikipedia.org/wiki/European_Union_free_trade_agre...).
Maybe it's possible for the UK to get custom tailored agreements that are more beneficial. But I'm afraid that until all of that is settled, a lot of time will have passed. Negotiation about the FTA between EU and Japan has been going on for about four years now. Other fora of exchange have been established decades ago. Until the UK can benefit from their own negotiation efforts, the EU might look more attractive to Japanese investments and trade.
International trade is complicated and takes time but the Leave campaign made it look like everything's going to be fine in just a few years.