boppo1

>massive interest in local AI

Gosh I just read a really hellish thread on what frontier LLMs will become as they're infected with advertising, I hope apple manages to break locsl LLMs (and training?) Into the public discourse

I've been way out of the local game for a while now, what's the best way to run models for a fairly technical user? I was using llama.cpp in the command line before and using bash files for prompts.

I havent been using my claude sub lately but I liked 4.6 three weeks ago. Did something change?

>Especially as local LLM continues to develop so fast.

I'm sorry is there anything even close to sonnet, much less opus, that can be run on a 4080? Or 64gb of ram, even slowly?

Last I heard, claude was the model powering maven when it bombed that school. Most aren't up-to date on that because anthropic launders their culpability through palanntir. Anthropic is better at optics not ethics.

>render video assets without needing FFmpeg on the server.

Help me understand: able to do video with less compute? Or offload compute to client browsers?

This kind of bureaucracy sounds like the stuff my teachers criticised communism and socialism for in school. Isn't our 'capitalist' system supposed to thwart this?

Is qwen 3.5 any good for chatting? I use chatgpt for 'light therapy' (basically sounding out confusing social situations my friends don't want to walk me through) and it's honestly been amazing. But I would rather not give all that to openai.

Damn I saw the headline and though it was a bill about general computing

Because I think it's boring work. You seem to think I'm speaking from a place of jealousy, I'm not.

>The bar for human juniors is now way higher than it used to be.

What do you think that is now? How does someone signal being 'past the bar'? If I hand wrote a toy gaussian splat renderer is that better than someone who used AI to implement a well optimized one with lots of features in vulkan?

> think the folks burning thousands of dollars of credits are unable to describe what they want.

Basically, yes. I bought 'business tier' and I know about webdev but I'm somewhere between intern and junior, so I do a lot of discussing. One session is "I want [functionality and constraints], ask me relevant major design questions" then implementation, then me investigating and asking for fixes.

As an artist, this isn't incredible. Arranging lights/darks to copy a photo is high-school tier. Money for food + shelter + materials and I could do this in a month, as with anyone who can copy a black and white photo.

Our greatest ally doesn't extradite??

Tell me more before I doom about this too much.

Please elaborate

Please elaborate.

I'm interested in color space math, is your project public?

>small group of people who are essentially driving all this all across the world in every industry.

The federal reserve?

>Where are the salary bumps to reflect this?

Revenue bumps and ROI bumps both gotta come first. Iirc, there's a struggle with the first one.

Which paper?

Humans are too lazy to bother.

>particularly high profile example would be the plot to kidnap a state governor a few years ago.

iirc that was something more than infiltration. The FBI found an extremist loser who lived in a basement, egged him on, helped him network & gave him resources. Without them, he probably would have been thinking really hard about it, not much more.

Can you say more?

New to webdev, coming from graphics:

What is better than react? I started with direct dom manipulation and it was a nightmare for making a 'modern' experience.

Eh, I stuck it in a docker container with pass-thru to my repo directory and I feel pretty safe about letting it fly.

Then again I dont work on anything serious.

I've been using 5.2 a lot lately but hit my quota for the first time (and will probably continue to hit it most weeks) so I shelled out for claude code. What differences do you notice? Any 'metagame' that would be helpful?

>I could spend an hour and have a full setup done on physical or VPS to have 1) remote git hosting 2) pipelines running on changes 3) pipelines publishing images or some artifacts 4) automated deployment for these images/artifacts

This sounds like a week or two of work to me (I'm a novice though). You should write a guide.

Blender does it

lol Adam Smith called this. The Wealth of Nations is all about how nominal increases in how the rich measure their wealth aren't really 'good economy', it's the goods and services and upward economic mobility everyday people have access to