I've long considered creating a KVM IP thingie for VGA video with a BeagleBone Black. IIRC the PRUs (200mhz coprocessors) and the on-chip ADC should be fast enough to sample the video as-is, and have DMA access into main-cpu ram.