> For ultrafast latency, only activations need to be passed between the wafers, and this can be done via RDMA over Ethernet.
I believe it for decode but the article says nothing about how they make prefill fast on that interconnect story :/.
I believe it for decode but the article says nothing about how they make prefill fast on that interconnect story :/.
No comments yet.