You’re saying that a hardware security module is like rot13?
When you say the attacker “only” needs to get them out, the “only” is doing a lot of work, there.
When you say the attacker “only” needs to get them out, the “only” is doing a lot of work, there.
I'd say handing the key to the attacker in a package that requires somewhere between a skilled reverse-engineer and a semiconductor lab to untangle falls far short of that standard.