124 karma · joined October 9, 2024
Meta has free and generous APIs for the crappy Llama 4 models... they're okay at summarizing things but I have no idea if its any good for code. Prob not since no one even talks about those anymore.
As for sharing code, most of the parts of a project/app/whatever have already been done and if an experienced developer hears what your idea is, they could just make it and figure it out without any code. The code itself doesn't really seem that valuable (well.. sometimes). Someone can just look at a screenshot of my aicodeprep app and just make one and make it look the same too.
Not all the time of course - If I had some really unique sophisticated algorithms that I knew almost no one else would or has figured out, I would be more careful.
Speaking of privacy.. a while back a thought popped into my head about Slack, and all these unencrypted chat's businesses use. It kinda does seem crazy to do all your business operations over unencrypted chat, Slack rooms.. I personally would not trust Zuckerberg to not look in there and run lots of LLMs through all the conversations to find anything 'good'! Microsoft.. kinda doubt would do that on purpose but what's to stop a rogue employee from finding out some trade secrets etc.. I'd be suprised if it hasn't been done. Security is not usually a priority in tech. They half-ass care about your personal info.
The surgical context tool (aicodeprep-gui) - there are at least 30 similar tools but most (if not all) are CLI only/no UI. I like UIs, I work faster with them for things like choosing individual files out of a big tree (at least it is using PySide6 library which is "lite" (could go lighter maybe), i HATE that too many things use webview/browsers. All the options on it are there for good reasons, its all focused on things that annoy me..and slow things down: like doing something repeatedly (copy paste copy paste or typing the same sentence over and over every time i have to do a certain thing with the AI and my code.
If you have not run 'aicp' (the command i gave it, but also there is a OS installer menu that will add a Windows/Mac/Linux right click context menu in their file managers) in a folder before, it will try to scan recursively to find code files, but it skips things like node_modules or .venv. but otherwise assumes most types of code files will probably be added so it checks them. You can fine tune it, add some .md or txt files or stuff in there that isn't code but might be helpful. When you generate the context block it puts the text inside the prompt box on the top AND/OR bottom - doing both can get better responses from AI.
It saves every file that is checked, and saves the window size, other window prefs, so you don't have to resize the window again. It saves the state of which files are checked so its less work / time next time. I have been just pasting the output from the LLMs into an agent like Cline but I am wondering if I should add browser automation / browser extension that does the copy pasting and also add option to edit / change files right after grabbing the output from a web chat. Its probably about good enough as it is though, not sure I want to make it into a big thing.
--- Yeah I just keep coming back to this workflow, its very reliable. I have not tried Claude Code yet but I will soon to see if they solved any of these problems.
Strange this thing has been at the top of hacker news for hours and hours.. weird! My server logs are just constant scrolling
Continue and Zed.. gonna check them out, prompts in Cline are too long. I was thinking of just making my own VS Code extension but I need to try Claude Code with GLM 4.5 (heard it pairs nicely)
Not sure if GLM-4.5 Air is good, but non-Air one is fabulous. I know for free API access there is pollinations ai project. Also llm7. If you just use the web chat's you can use most of the best models for free without API. There are ways to 'emulate' an API automatically.. I was thinking about adding this to my aicodeprep-gui app so it could automatically paste and then cut. Some MCP servers exist that you can use and it will automatically paste or cut from those web chat's and route it to an API interface.
OpenAI offers free tokens for most models, 2.5mil or 250k depending on model. Cerebras has some free limits, Gemini... Meta has plentiful free API for Llama 4 because.. lets face it, it sucks, but it is okay/not bad for stuff like summarizing text.
If you really wanted to code for exactly $0 you could use pollinations ai, in Cline extension (for VS Code) set to use "openai-large" (which is GPT 4.1). If you plan using all the best web chat's like Kimi K2, z.ai's GLM models, Qwen 3 chat, Gemini in AI Studio, OpenAI playground with o3 or o4-mini. You can go forever without being charged money. Pollinations 'openai-large' works fine in Cline as an agent to edit files for you etc.
Every month so many new models come out. My new fav is GLM-4.5... Kimi K2 is also good, and Qwen3-Coder 480b, or 2507 instruct.. very good as well. All of those work really well in any agentic environment/in agent tools.
I made a context helper app ( https://wuu73.org/aicp ) which is linked to from there which helps jump back and forth from all the different AI chat tabs i have open (which is almost always totally free, and I get the best output from those) to my IDE. The app tries to remove all friction, and annoyances, when you are working with the native web chat interfaces for all the AIs. Its free and has been getting great feedback, criticism welcome.
It helps the going from IDE <----> web chat tabs. Made it for myself to save time and I prefer the UI (PySide6 UI so much lighter than a webview)
Its got Preset buttons to add text that you find yourself typing very often, per-project state saves of window size of app and which files were used for context. So next time, it opens at same state.
Auto scans for code files, guesses likely ones needed, prompt box that can put the text above and below the code context (seems to help make the output better). One of my buttons is set to: "Write a prompt for Cline, the AI coding agent, enclose the whole prompt in a single code tag for easy copy and pasting. Break the tasks into some smaller tasks with enough detail and explanations to guide Cline. Use search and replace blocks with plain language to help it find where to edit"
What i do for problem solving, figuring out bugs: I'm usually in VS Code and i type aicp in terminal to open the app. Fine tune any files already checked, type what i am trying to do or what problem i have to fix, click Cline button, click Generate Context!. Paste into GLM-4.5, sometimes o3 or o4-mini, GPT-5, Gemini 2.5 Pro.. if its a super hard thing i'll try 2 or 3 models. I'll look and see which one makes the most sense and just copy and paste into Cline in VS Code - set to GPT 4.1 which is unlimited/free.. 4.1 isn't super crazy smart or anything but it follows orders... it will do whatever you ask, reliably. AND, it will correct minor mistakes from the bigger model's output. The bigger smarter models can figure out the details, and they'll write a prompt that is a task list with how-to's and why's perfect for 4.1 to go and do in agent mode....
You can code for free this way unlimited, and its the smartest the models will be. Anytime you throw some tools or MCPs at a model it dumbs them down.... AND you waste money on all the API costs having to use Claude 4 for everything