Quite right.

But the adoption of video formats is hampered by the lack of a fast en/decoder.

The people pushing for the adoption of one or anther codec really ought sink their time and money into making ffmpeg work really well.

They gain nothing from saying "it could be really fast" when all people looking for a format to use for something have is a slow reference implementation.