Can I run this LLM?

canirunthisllm.com

26 pointsweinzierl4 comments

Is the site dead? Or does it use strange features that keep it from working universally? I just see strobing grey lines...

It finally loaded after several minutes. I see the device pulldown is large, yet there's no scrollbar, and there's no way to search. And from what I see, it doesn't seem to have any CPU based devices yet.

Hopefully it'll improve over time.

It worked for me (FF, Android, surprisingly fast hotel wifi), in that it loaded, I could select a GPU from a drop-down, a model from another drop-down, and push a button that gave me some information and a configuration example.

I tried a few combinations, they all worked.

Eventually.

(It was not a very fast website.)

Bump- on 4G and gave the site like 30 seconds and left after only skeleton loader.

Looks like it’s built on Streamlit Python library and hence a bit slower

Reply on news.ycombinator.com