It would be better to run the vectors through an attention layer if you want sentence to sentence translation.