This is baffling. It would be remarkably easy to memorize 12 words, then keep no active wallet anywhere. When you want to send coins, start up a desktop wallet, enter the 12 words, send some Bitcoin, then delete the wallet.
(I understand these hardware wallets let you load up as many as you want.)