This solution isn't great, there is direct support for the V4L2 codec API inside ffmpeg. So vaapi is not useful in this case.