On the other hand, if you do include the cost of the hardware it doesn't seem change the overall conclusion.
They gave me a 90 day evaluation window.
They did this because it benefits them.
I paid 35% above retail for the card.
And I'm the greedy one ? really ?
Someone needs redpilled on how the monkey planet really works, which was the entire point of this post.
We can choose to spend months crying about card prices and waiting for christmas, or ...
We can choose to analyse the market, calculate risk for our projects, and move forward confidently after doing so.
Or, we can stand on the sidelines and throw rocks at the marathon contestants because they pooped on our lawn.
Choose wisely.
Edit: I do like that you came back to edit a whole bunch more into your reasoning. So I'll do the same.
I like that you describe yourself as someone who shits on other people's lawns.
I fully believe that you randomly shit on other people's lawns but this marathon you've imagined yourself in is pure delusion.
I wish you much success in life.
Thank you for contributing to current year.
Seems like a great way to help the species get a bit lower still.
MBA school calls it responsible corporate stewardship.
As for MBA school, don’t really give a shit how it is colorfully worded to attempt to excuse it.
In fact I'm running qwen3.8-flash-next with a Playwright-mcp docker and it is far better for scraping than my ChatGPT or Claude subscription, for the simple reason that sites aren't lying to Playwright.
Not to invalidate your point, just saying it's a bit of a straw man.
The 5060 wasn't the fastest/$, it just provided the most VRAM / $ as of yesterday.
Im installing it in a box with a 4070 Ti to run 2 different models simultaneously. Coder + MoE via paperclip or multica.
That probably is the cheapest per 1 GB vram right now. However, the R9700 a few months ago was only $1350/32GB or $42/1GB VRAM. And everyone knew it, because the card is now $1800 or so with supply issues.
I think the market discovered the reasonable min is 32GB. That runs Qwen3.8 Q6 with 100k+ context all in vram. 24GB does not.
You're counting on most people being willing to abuse a return policy like that. Also, the 3 month return window must've activated 3 days ago. These prices didn't start just then.
You can also keep it and return a bag of flour weighing the same.
Or even go to people houses and rob them at gun point to steal their hardware.
localaicost.com
- rate at which tokens are generated
- quality of generated tokens
- ethics of abusing return policies
- long-term viability of abusing return policiesquality determined by model(s) and model size(s), not card size.
no return policy has been abused, you imagined this.
the plan was for 1 card today.
RIF.
I too did a cost breakdown of buying my GPU for ~10K EUR more than a year ago. It came out "Invaluable" as I use it for analyzing my diary, financials and other private things I cannot send to random 3rd parties.
But even the best of models you can run with 96GB VRAM really doesn't come close to the hosted SOTA models, sadly.
What scam are you speaking of ? The return window ?
I don't plan on returning it, unless the economics of upgrading in 89 days favor doing so.
The point was to calculate "my risk" on the transaction.
As for the results of the calculation, I didn't invent math or risk.
For $80 total "risk", I can get 10+ programmers worth of work for 3 months. A much better gamble than paying per token.
Your calculation seems to have depended on "Buy this hardware with the explicit intention of returning it" process, which is a scam. If you buy hardware you do so with the intent of keeping it, otherwise you find renters, if you don't like scams.
So if you don't plan to return it, wouldn't the cost at minimum be the cost of the GPU??? Why count on returning it if you don't plan to do so?
What people don't like is the environment, and they just decided to stone my post to death for adapting to it, instead of doing the same.
People are just being people.
I'm a much easier target than that Sam guy, who locked up 40% of the planets GPU's using purchase orders, with no obligation to follow through.
He's an untouchable elite. I'm much easier to mug.
We are all opportunists.
The entire thinking behind the post, was spawned by the article the other day, about the "video game construction kit" guy, bragging about spending $3.1 million a month on tokens in an article, with $0 revenue.
Also even if you can somehow fit a few 100 billion parameter model(like gpt 6 luna or deepseek flash) in 16GB, and magically assume you can run at 200 tokens/sec according to your calculation, the blended cost of it would be around $100, not $1639.
The exact same ones are now pushing $300/ssd and Samsung's (which was $300 18 months ago) is now $500.
The prices are insane.
What it does buy, though, is privacy and freedom (nobody can decide to "change the terms" to milk you more).
It’s akin to saying “the new iPhone costs $2.5k, it weighs 250 g, I can get a piece of scrap aluminium for $30, checkmate liberals.”
This seems more like a sociopathic "hack" than an actual comment on the economy of selfhost vs inference-as-a-service.