We do actually police dual use things if the other use is deemed dangerous enough. I don't see LLMs as particularly dangerous, so would not put them in that category.
If for example you were the Chinese government you may already see LLMs as highly dangerous to your plans of social stability, hence make a lot of rules now on their policing.
That's the idealistic view anyway. A more cynical one might be that in the West, the flow of power from the top down is obfuscated by filtering it through the media and other institutions, who manufacture public consensus, and LLMs are liable to disrupt this system in a way those in power can't predict right now.