HNHacker News
TopNewBestAskShowJobs

pancomplex

685 karma · joined October 14, 2015

CTO @ Frigade (YC W23)
submissionscomments
pancomplex··on Show HN: Jev Plays Pokémon Red
Rookie mistake clearly..
pancomplex··on Show HN: Jev Plays Pokémon Red
True!
pancomplex··on Show HN: Jev Plays Pokémon Red
In my experience it was too slow to do an FPS with 30 ticks per second reliably. It gets killed too fast.
pancomplex··on Show HN: Jev Plays Pokémon Red
Working on it :)
pancomplex··on Show HN: Jev Plays Pokémon Red
Frontier reasoning models do pretty well in Pokemon: https://github.com/benchflow-ai/pokemon-gym

The interesting thing here imo is the cost and latency. So far we're at 4 badges for less than $0.5

pancomplex··on Show HN: Jev Plays Pokémon Red
People need to be live streaming their AI more!
pancomplex··on Show HN: Jev Plays Pokémon Red
Jev can't come up with original text, but I did consider giving it a list of hilarious names.
pancomplex··on Show HN: Give your AI agent on-screen guides that show users where to click
Thank you!
pancomplex··on Show HN: Give your AI agent on-screen guides that show users where to click
Very much agree with the sentiment here - I actually even wrote a blog post about this specific issue lately. There's an entirely separate issue of AI slop ruining well-defined clean applications: https://frigade.com/blog/easier-to-build-not-easier-to-use
pancomplex··on Show HN: Give your AI agent on-screen guides that show users where to click
Yes for sure. We actually use the map we build of the UI + the questions people ask to automatically identify product gap patterns. These are the presented in a dashboard where you can use these insights to improve the product itself.
pancomplex··on Show HN: Yap – OSS on-device voice dictation for macOS with no model to download
I'm considering adding a feature to include auto punctuation and capitalization. Would that solve it for you?
pancomplex··on Show HN: Yap – OSS on-device voice dictation for macOS with no model to download
Sorry about these issues - appreciate all the details. Are you on an Intel Mac by any chance?
pancomplex··on Show HN: Yap – OSS on-device voice dictation for macOS with no model to download
Apple's built in dictation still executes parts of it online and even has a disclosure that it "sends information like your voice input, contacts, and location to Apple."

This project uses the on-device SpeechAnalyzer API directly and makes zero network calls, and since it's open source you can verify that nothing leaves your Mac.

pancomplex··on Show HN: Yap – OSS on-device voice dictation for macOS with no model to download
Thank you for this feedback! Heard from other folks the menu bar is redundant too - will kill it in the next update and fix the F13 issue.

And interesting re: history - it does have the option to clear, but you’d want that as a setting?

Trying to keep the amount of settings to a minimum - personally finding it overwhelming when apps have too many bells and whistles lol

pancomplex··on Show HN: Yap – OSS on-device voice dictation for macOS with no model to download
Totally! I honestly think so many frontier AI models will be running locally in the future. This is just the start.
pancomplex··on Show HN: Yap – OSS on-device voice dictation for macOS with no model to download
It's a great name. Glad someone else thought of something similar!
pancomplex··on Show HN: Yap – OSS on-device voice dictation for macOS with no model to download
I think it once did! Now it doesn't - ways to easily verify this:

1) install the dmg in the GH repo

2) turn off wifi

3) use it offline

pancomplex··on Show HN: Yap – OSS on-device voice dictation for macOS with no model to download
That would be a super trivial fork actually! You basically just need this file https://github.com/FrigadeHQ/yap/blob/main/Sources/Services/... and then wrap a cli around it :)
pancomplex··on Show HN: Yap – OSS on-device voice dictation for macOS with no model to download
I don't think you're missing something - Apple's built in dictation is pretty good. The biggest issue is that it still executes parts of it online via Apple's servers and even has a disclosure that it "sends information like your voice input, contacts, and location to Apple."

This project uses the on-device SpeechAnalyzer API directly and makes zero network calls, and since it's open source you can verify that nothing leaves your Mac. It also keeps a local searchable history. Finally, I also added press-to-stop with a preview so you can cancel a bad take before it inserts, instead of typing live (very useful in terminal).

What type of package were you hoping it was?

pancomplex··on Show HN: Yap – OSS on-device voice dictation for macOS with no model to download
Thanks for linking! I've used both Apple's and Parakeet locally for a while and haven't been able to spot the difference in quality and speed is better on Apple's model (+ doesn't take several gigs of memory). Have you noticed any quality differences anecdotally?
pancomplex··on Show HN: Yap – OSS on-device voice dictation for macOS with no model to download
My bad - this is now fixed. Thank you!
pancomplex··on Show HN: Reverse-engineering web apps into agent tools
Luckily no. The calls are executed client-side just like they would if you were using the UI.
pancomplex··on Show HN: Reverse-engineering web apps into agent tools
We only do this with consent from the application owner - the use case is typically companies who don’t have an AI agent yet who want fast path to get one.

This is the process we usually do: https://frigade.com/how-it-works

pancomplex··on Show HN: Reverse-engineering web apps into agent tools
This works for non-authenticated sites but wouldn't work for anything behind a login wall that requires a JWT or similar - right?
pancomplex··on Show HN: Reverse-engineering web apps into agent tools
Yup just another user account. It can work without this as well (we support ingesting other resources such as help center articles, pdfs, etc.) but at that point it's no different from any other (dumb) AI chatbot out there that just spits out a bunch of itemized bullets.
pancomplex··on Show HN: Reverse-engineering web apps into agent tools
Even with an API spec it wouldn't "just work". You'd still need to handle authentication and have a place to manage which APIs you want the in-app agent to have access to / when to call a given tool.

And believe it or not, even big companies with big eng teams don't have API specs available for their applications ¯\_(ツ)_/¯

pancomplex··on Show HN: Reverse-engineering web apps into agent tools
We can either replace an intercom widget entirely or do a hand off with context to a live intercom chat agent.
pancomplex··on Show HN: Reverse-engineering web apps into agent tools
Here's a more thorough explanation of how it works under the hood: https://frigade.com/features/skills
pancomplex··on Show HN: Reverse-engineering web apps into agent tools
Agreed - and especially when the API changes..
pancomplex··on Show HN: Reverse-engineering web apps into agent tools
We use a browser-based agent to learn all the APIs and turn them into skills. Most users will run this in a staging/test account to create all the recipes/blueprints. Our agent is also instructed to not take any destructive actions - but of course LLMs make mistakes (hence the test account :) ).

You can see more about how it works in detail here: https://frigade.com/how-it-works

← PreviousPage 2 of 5Next →