Dude are they trying to get dupped like ArtCraft with Photoshop?
498 karma · joined January 31, 2022
Not a fan of the gambling stuff either.
Its progress, but IMO its not worth workflow jumping until you've got existing purchase on a working flow.
It depends, but usually spin up an h100 on lambda.ai or coreweave. They have capacity and their UIs/APIs are nice. I spin it up for an hour or two, believe it was 6~ dollars an hour.
Once the gpu instance is up, you need to run vllm and a model, ie https://docs.lambda.ai/education/large-language-models/deplo....
Then you can connect your pi.dev, openwebui, etc etc to vllm and interact with it like normal.
Yes there is a cost to training Doctors but you can't tell me its worth the burnout rate?