NNEDI3, which I mentioned in another comment, can be used for video upscaling, and was in fact built for video processing in the first place.