If the $50k is your paid up registered capital, you can loan out the money back to yourself as a loan to director or even another legal entity (such as a US or foreign corporation, LLC, LP, etc.). The $50k of registered capital (the investment to secure the visa) would remain on the balance sheet.
Perhaps you could remain in business and assist foreigners with setting up Japanese companies.