I don't know anything about this field. Are these distributed systems? A billion 1024 dimensional vectors sounds like a whole lot of memory (8 TB if each dimension is a double?).