HNHacker News
TopNewBestAskShowJobs

mycelia

14 karma · joined May 27, 2022

submissionscomments

LLM Inference with Ray: Expert parallelism and prefill/decode disaggregation

anyscale.com·1 pts·mycelia·
0

LLM Engine Orchestration for Performance

anyscale.com·1 pts·mycelia·
0