Using some pre-memorized number associations helps a lot with this, like peg systems.
https://en.wikipedia.org/wiki/Mnemonic_peg_system
personally I do something like 0 egg 1 pen 2 swan 3 butt 4 sailboat .. etc.. and then make a little story for the number using the interaction of those things. This is not for long term memorisations, but just for recall in the mid term.