HNHacker News
TopNewBestAskShowJobs

mkaushik

34 karma · joined July 24, 2015

submissionscomments

Optimizing Inference on LLMs with NVIDIA TensorRT-LLM

developer.nvidia.com·3 pts·mkaushik·
1

NVIDIA introduces TensorRT-LLM for accelerating LLM inference on H100/A100 GPUs

developer.nvidia.com·69 pts·mkaushik·
21