OpenEXR solved that problem years ago and it's supported by virtually all content creation tools. An open source implementation with a well designed C++ api and bindings to several other languages.
For reasons that I don't understand, it's adoption is weak outside of the VFX industry.