The question is whether creating the derivative work of that specific transformative nature is allowed. Unlike assets taken verbatim, this requires evaluating the exact instance. A binary decompilation is importantly not a simple translation, as that would be entirely unusable - rather, it is like creating blueprints for a finished building.
This is in part why licenses aim to manage and in part restrict you through a contract with the author, using a formally granted usage right to the entity as leverage for complying with a bunch of conditions, orthogonal to the copyright.
Your point stands though, my statement was not as accurate as it could have been.