HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by om8 | Hacker News Reader
Parent
Full thread
om8
·
Sure, but integrated graphics usually lacks vram for LLM inference.
View on HN
adastra22
·
Which means that inference would be approximately the same speed (but compute offloaded) as the suggested CPU inference engine.
Reply on news.ycombinator.com