HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by john_alan | Hacker News Reader
Parent
Full thread
john_alan
·
you can't run models that are bigger than 16GB, not comparable.
View on HN
nickthegreek
·
sure you can. system ram is will be your limiter here.
john_alan
·
it's too slow for usable inference though.
nickthegreek
·
Slow and can’t run are different things, but I get your point.
Reply on news.ycombinator.com