HNHacker News
TopNewBestAskShowJobs

theredsix

158 karma · joined March 10, 2017

submissionscomments
theredsix··on Show HN: Open-source browser for AI agents
Totally, I feel that CDP was designed for a different category of automations.
theredsix··on Show HN: Open-source browser for AI agents
Op here, happy to answer any question!
theredsix··on Show HN: Deterministic browser control for AI agents (~90% on Mind2Web)
Exactly, the harness or protocol can matter just as much!
theredsix··on Show HN: Deterministic browser control for AI agents (~90% on Mind2Web)
The difference is that we make browser use turn-based and return a single structured result per action.

With most other tools, the model is interacting with a live browser and effectively has to reason through a stream of low-level events while the page keeps changing. We instead freeze the page, let the model request one action, execute it, allow all resulting browser events to play out, then freeze again and return one bundled response with everything that happened plus the new stable page state.

So the model isn’t chasing a moving UI or event stream. It gets one grounded step at a time. A big part of the performance gain seems to come from that holistic action envelope.

theredsix··on Show HN: Deterministic browser control for AI agents (~90% on Mind2Web)
Hi HN, op here! This is an open source browser protocol for LLM agents.

The browser shows the model the current page, the model chooses the next action, and the browser returns the new state. Between steps, JavaScript and time are frozen so the page stays still while the model thinks.

That makes things like ecommerce shopping and popup-heavy web app workflows much more reliable.

Using this setup, the project gets ~90% on Online Mind2Web. My bet is that browser agents need a protocol designed for models, not just wrappers around CDP.

theredsix··on The First Fully General Computer Action Model
This is one of those hacker news posts that you stumble upon and see 2 genius ideas within the span of as many paragraphs. Thanks again for sharing the diffusion based labeling algorithm. Truly demonstrates a mastery and understanding of what diffusion is capable of.
theredsix··on Making a live-mode test payment to yourself = a payment processor ToS violation?
If you need to test in production, have a family relative or friend buy the product/subscription and then make them whole offline. Also, do not reverse or refund the transaction.
theredsix··on Show HN: I wrote an open-source browser alternative for Computer Use for any LLM
I had an older version that used simplified HTML, and it got to decent performance with GPT-4o and Gemini but at the cost of 10x token usage. You are right, identifying the interactable elements and pulling out their values into a prompt structure to explicitly allow the next actions can boost performance, especially if done with grammar like structured outputs or guidance-llm. However, I saw that Claude had similar levels of performance with pure vision, and I felt that vision + more training would beat a specialized DOM algorithm due to "the bitter lesson".

BTW I really like your handling of browser tabs, I think it's really clever.

theredsix··on Show HN: I wrote an open-source browser alternative for Computer Use for any LLM
Awesome project, starred! Here are some other projects for agentic browser interactions:

* Cerebellum (Typescript): https://github.com/theredsix/cerebellum

* Skyvern: https://github.com/Skyvern-AI/skyvern

Disclaimer: I am the author of Cerebellum

theredsix··on Show HN: Cerebellum – Open-Source Browser Control with Claude 3.5 Computer Use
Update: We had a contributor start a Python port, stay tuned!
theredsix··on Show HN: Cerebellum – Open-Source Browser Control with Claude 3.5 Computer Use
It's on the roadmap! A few other priorities are higher at the moment, but we'll be excited to see a PR for it in the meantime.
theredsix··on Show HN: Cerebellum – Open-Source Browser Control with Claude 3.5 Computer Use
They don't discuss this at all on their blog other than "Training Claude to count pixels accurately was critical." My speculation on how they accomplished it is either explicit tokenizer support with spacial encoding similar to how single-digit tokenization improves math abilities or an extensive pretraining like Molmo.
theredsix··on Show HN: Cerebellum – Open-Source Browser Control with Claude 3.5 Computer Use
I think if you added additional function calls to detect visual bugs or breaking flows, tools such as this could automate much of QA in addition to detecting non-intuitive UI design patterns.
theredsix··on Show HN: Cerebellum – Open-Source Browser Control with Claude 3.5 Computer Use
Selenium works on webdriver v4 and the screenshot is transferred as an image by the webdriver protocol. Perhaps modifying DOM before triggering the screenshot and then reverting the changes can work. PRs are welcome!
theredsix··on Show HN: Cerebellum – Open-Source Browser Control with Claude 3.5 Computer Use
The next step will be adding functionality to convert and save a BrowserStep[] into a portable file format and addition conversation functions to turn those files into .jsonl that can be fed into the transformers library etc. For the PII piece, there's no current plans to introduce anonymization features but open to suggestions.
theredsix··on Show HN: Cerebellum – Open-Source Browser Control with Claude 3.5 Computer Use
Not at the moment, since you need a local model with strong segmentation capabilities (x, y) and none exist ATM. We hope to train one in the future and one of Cerebellum's roadmap items is to create a the ability to save your sessions as a training dataset.
theredsix··on Show HN: Cerebellum – Open-Source Browser Control with Claude 3.5 Computer Use
OP here, happy to answer any questions you may have!
theredsix··on Show HN: Lightweight browser automation powered by Claude 3.5 Sonnet
Hi OP here, happy to answer any question!
theredsix··on Using an 8K TV as a Monitor
You get the partner something shiny too!
theredsix··on Ask HN: Google Ads Rejected My SaaS as Compromised Site
what's your website?
theredsix··on Launch HN: Stack Auth (YC S24) – An Open-Source Auth0/Clerk Alternative
You should evaluate the FOSS software features AS IS and ask if you're okay with the current feature set if all future features are behind an "enterprise" tier. If you are, and the hosting of the current version is manageable, then the product is good for both sides. I've often found running the numbers for paying the vendor for cloud vs amortizing devOps costs comes out in favor of the cloud version. I see this as a win-win for both the customer and the company.
theredsix··on Panic at the Job Market
The author's tone is condescending, angry and entitled. If everyday interactions with him followed the same tone, I would argue that he is the exact type of person behavioral interviews are meant to screen out (technically competent but a nightmare to work with).
theredsix··on Bun v1.0.0
Congrats on the release!
theredsix··on Webflow locks basic front end security behind Enterprise Plan
We were looking to enable HSTS for our Webflow landing page and were surprised that this feature was gated behind the enterprise plan paywall.

As it stands, Webflow customers cannot enable CSP, or HSTS on their pages without upgrading to the enterprise plan which does not even have published pricing: https://webflow.com/pricing

On the same page they explicitly state they do not provide support for security headers so this is not a support cost consideration and appears to be another tax on security.

theredsix··on Reverse engineering the Nest home/away API
Clever use of static IPs, loved the write up!
theredsix··on It’s easier to manage four people than one person
I've definitely noticed this in the past and it's good to see a concise logical reasoning of the problem.
theredsix··on Show HN: Paladin Cyber (YC S17)- Free browser security and protection for Chrome
Han from Paladin here. We are really excited to launch our latest Chrome Extension and excited to get feedback from users like you.

Paladin was founded as a Cyber Protection company for SMBs. One of the products that we began building was a cyber protection tool suite for employers to give to their employees. The tool would help mitigate the risk of being hacked. We also provided remediation services, that was all backstopped by a cyber insurance policy. Our chrome extension was built with NSA level encryption and security measures, and we realized that we couldn’t just let this chrome extension hide behind a wall only for small businesses.

Once we had tested our chrome extension extensively, we decided to take our mission of making cyber protection easy for the little guy, and extend it to consumers by offering our Paladin Browser Protection for Chrome to the general consumer, free of charge.

As consumers and internet users we are often at risk of being hacked, even when we don’t necessarily realize it. Add to that the fact that most available tools out there are really only band-aids, incomplete, or act as medicine, we realized it was important to build a vaccine. Paladin Browser Protection for Chrome provides protection against the top 5 consumer vulnerabilities:

Weak passwords, unsecured public WiFi, phishing emails and website, unsafe content and XSS vulnerabilities and attacks. Here’s a breakdown of the features and how they work:

- Password management -65% of people use a single password among all applications, so when one login is breached, they all will be. Setup a single sign-on password with our password manager and generate strong passwords for all of your logins.

- Phishing protection - 91% of successful hacking attempts start with phishing emails. With Paladin’s Browser Protection Chrome Extension we protect your inbox (compatible with Gmail and Outlook365) by calling out malicious attempts so you don’t get hacked.

- Unsecured WiFi protection - 68% of public and unsecured wifi users fall victim to an attack. We encrypt all your data before it goes to the router, then route it back through our servers, leaving you clear of any danger.

- Website and content filtering - 99% of known threats are blocked by our filter. The filter prevents you from accessing all phishing websites along with other unsafe sites

- Cross-site scripting protection - 50% of websites are affected by XSS vulnerability. A script attack allows a hacker to transfer malicious code right through a normally visited website. We stop them dead in their tracks and report back to Paladin and the authorities to take them down.

Explore the chrome extension, test it out, and let us know what you think. I’m here to answer your questions.

← PreviousPage 2 of 2