You could run a portable browser in a portable sandbox stored on a VeraCrypt volume, so none of your browsing data is on disk at all.
Librewolf comes with an auto-updater exe which I would just rename. You can manually update it by grabbing the latest installer exe, extracting, and manually copying the librewolf folder across.
Sandboxie has a few things to configure but are mostly self-explanatory. Looking at breakout apps and file/folder permissions will be useful if you want to still be able to save to the local harddrive outside the sandbox.