What the paper clip maximiser is doing is generating harmful unintended instrumental goals, such as killing the humans so that they can’t stop it making more Paperclips.
Sure, but I wouldn't consider it reward hacking if we knowingly gave it the goal of maximizing papercips and it did this. Maybe I'm being pedantic, but that would be a pretty clear due diligence failure on the prompter's fault.