I wonder if something like AMD's SSD+GPU combo would improve the performance of this? Increasing the usable buffer size.
Having said that there are some early techniques out there for DMA from NVMe drives to GPU ram directly. Like this: http://kaigai.hatenablog.com/entry/2016/09/08/003556