IhateAI

"Is they key unlock here"

Just code it yourself, you might surprise yourself :)

You're delusional, I didn't even include the labor the install and run the damn thing. More than 500k

Imagine thinking that $80k setups to run Kimi and serve a single user session is evidence that inference providers are running at cost, or even close to it. Or that this fact is some sort of proof that token pricing will come down. All you one-shotted llm dependents said the same thing about Deepseek.

I know you need to cope because your competency is 1:1 correlated to the quality and quantity of tokens you can afford, so have fun with your Think for me SaaS while you can afford it. You have no clue the amount of engineering that goes into provide inference at scale. I wasn't even including the cost of labor.

I'm not making any guesses, I happen to know for a fact what it costs. Please go try to sell inference and compete on price. You actually have no clue what you're talking about. I knew when I sent that response I was going to get "but Kimi!"

What do weights have to do with how much it costs to run inference? Inference is heavily subsidized, the economics of it don't make any sense.

Anthropic and OpenAI could open source their models and it wouldn't make it any cheaper to run those models.. You still need $500k in GPUs and a boatload of electricity to serve like 3 concurrent sessions at a decent tok/ps.

There are no open source models, Chinese or otherwise that are going to be able to be run profitably and give you productivity gains comparable to a foundation model. No matter what, running LLMs is expensive and the capex required per tok/ps is only increasing, and the models are only getting more compute intensive.

The hardware market literally has to crash for this to make any sense from a profitability standpoint, and I don't see that happening, therefor prices have to go up. You can't just lose billions year after year forever. None of this makes sense to me. This is simple math but everyone is literally delusional atm.

Offshore windmills legitimately do interfere with some of these military radars monitoring the coastline that are probably top secret, or so I'm told by people that would know. However, I doubt that's the only reason of course.

This is the equivalent of a toddler being entertained by the sound the straps on their Velcro shoes make when they get peeled back and forth.

More adoption? I don't think so... It feels to me that these models && tools are getting more verbose/consuming more tokens to compensate for a decrease in usage. I know my usage of these tools has fallen off a cliff as it become glaringly obvious they're useful in very limited scopes.

I think most people start off overusing these tools, then they find the few small things that genuinely improve their workflows which tend to be isolated and small tasks.

Moltbot et al, to me, seems like a psyop by these companies to get token consumption back to levels that justify the investments they need. The clock is ticking, they need more money.

I'd put my money on token prices doubling to tripling over the next 12-24 months.

Just use lists, "Your Followers" tab and never touch the "For You" tab and its basically the same as Twitter was 5 years ago.

My guess would be certain IPs associated with universities, corporations and government institutions.

$5-9 a GB, its an infinite money glitch actually.

Its probably more of a me "problem". But I'm sure there are plenty of others that share my sentiment. It doesn't really have anything to do with it being familiar, familiar can be good, but what I'm talking about is a familiar ugliness and lack of intention.

The Stripe or Shopify checkout is familiar, but it only became familiar because it was well designed and people wanted to keep using it.

Also when its obvious someone used an LLM, it bleeds into my overall opinion of the product whether the product is good or not. I assume less effort was put into the project, which is probably a fair assumption.

How do you stop mobile proxies operating through similar nefarious business models... CGNAT prevents you from easily identifying the exit nodes.

Yep, and I refuse to use sites that look like this. Lovable built frontend/landing pages have a similar feel. Instant lost of trust and desire to try it out.

So many session cookies getting harvested right now.

Thank you, Its giving NFTs in 2022. About the most useful thing you could do with these things:

1. Resell tokens by scamming general public with false promises (IDEs, "agentic automation tools"), collect bag.

2. Impress brain dead VCs with FOMO with for loops and function calls hooked up to your favorite copyright laundering machine, collect bag.

3. Data entry (for things that aren't actually all that critical), save a little money (maybe), put someone who was already probably poor out of work! LFG!

4. Give into the laziest aspects of yourself and convince yourself you're saving time by having them writing text (code, emails ect) and ignoring how many future headaches you're actually causing for yourself. This applies to most shortcuts in life, I don't know why people think that it doesn't apply here.

I'm sure there are some other productive and genuinely useful use cases like translation or helping the disabled, but that is .00001% of tokens being produced.

I really really really can't wait for this these "applications" to go the way of NFT companies. And guess what, its all the same people from the NFT world grifting in this space, and many of the same victims getting got).

I don't think so, but you're still looking at a giant investment that can't really be justified for their capability.

Why would someone want to spend half a million dollars on GPUs and components (if not more) to run one year old models that genuinely aren't useful? You can't self host trillion parameter models unless you own a datacenter lol (or want to just light money on fire).