The index doesn't need to fit in the shared buffers to be built, but you can speed the queries if you load it to memory