I don't understand the JPEG XL frackus, but that's partly because I think the Web platform should not continue being an enormous ball of mud, with everything built into the browser with no layering.
Make a Wasm module (use SIMD and threads if you want) that can decode the format and render to an immutable canvas and then let the browser engine manage the pixels after that. Wasm is close enough to native speed now that it no longer makes sense to bake this into the native browser binary anymore.