Japan is a lot stricter than the US when it comes to driving in general. The minimum age is higher, the driving test is more difficult, it's easier to lose your license for traffic violations, speed limits are lower, mandated vehicle inspections are much more expensive/comprehensive, there is zero tolerance for drinking and driving (even one sip), etc. This is reflected in traffic fatality figures - 12.8 deaths per 100,000 people in the US vs 1.9 in Japan [1].
So while I'm not sure about the origin of manual vs automatic licenses specifically, it's not really surprising in the broader context of Japan's strict stance on driving.
In practice it means if you want to drive manual, you need to take the driving test in a manual - which is not unreasonable. But seeing as how only 13% of foreigners pass Japan's practical driving test on the first attempt (to be fair, it was easier back when I took it) [2], and I hadn't driven manual in years, I wasn't looking to make things any more difficult for myself.
Or there is also the option to take some lessons at a driving school and get certified to drive a manual (with the assessment at the end being easier than taking the official test). But I haven't really had a good reason to bother with this.
[1] https://ourworldindata.org/grapher/death-rates-road-incident...
[2] https://www.asahi.com/ajw/articles/16392895