FezzikTheGiant

genuinely what's the point of this comment? are you allergic to cool stuff? honestly curious as to what you were trying to achieve by this comment.

nowhere in this post does the author say that it's ready with the current state of models, or he'd use a foundation model for this. why the hate?

fair enough

what's the cost difference between groq/cerebras vs using something else for inferencing open source models? I'm guessing the speed comes at a cost?

i think lots of apps are going to go in the adaptive/generate ui direction - even if it starts a lot simpler than generating the code

would you be willing to pay for something that essentially is google inbox - but a separate web view client with more personalization/better search?

are you using whisper at the backend

Would people be willing to pay for a gmail plugin that takes a stab at combatting ai email spam? something like Mailman [1] but with an LLM layer for detecting AI slop?

[1]: https://mailmanhq.com/

Would you be willing to pay for a gmail plugin that takes a stab at this? something like Mailman [1] but with an LLM layer for detecting AI slop?

[1]: https://mailmanhq.com/

Could you name some?

The generative agents paper takes a pretty decent shot at this I think

I agree on the most part, but I still think some pretty cool games can come up with local LLMs. Suck up for example, though not local afaik, is a pretty cool one.

This is something I was considering as well - thanks

Can you explain further? Why would it not be free if it's running locally

Was playing around with this model - why does it return 2 or 3 responses when I ask it for one? I asked it for a json response and it generates 2 or 3 at a time. What's with this.

Thanks! This is helpful. I was thinking about the phi models - those might be useful for this task. Will look into how those can be run locally as well

What? chill out buddy - there's such a thing as timezones I was just sleeping

Is there a way to reliably package these models with existing games and make them run locally? This would virtually make inference free right?

What I think is, from my limited understanding about this field, if smaller models can run on consumer hardware reliably and speedily that would be a game changer.

how did you generate the data

yeah that's what I'm saying - it would eliminate inference costs. What I was asking is how feasible is it to package these local llms with another standalone app. For ex. a game

Interesting - is it viable do you think to package a llm like that with an existing game and run it locally - I assume it will be intensive to run but wouldn't that eliminate inference costs?

Are they able to run at a good speed? I'm just wondering what the economics would look like if I want to create agents in my games. I don't think many are going to be willing to get with usage based / token based pricing. That's the biggest roadblock with building LLM-based games right now.

Is there a way to reliably package these models with existing games and make them run locally? This would virtually make inference free right?

What I think is, from my limited understanding about this field, if smaller models can run on consumer hardware reliably and speedily that would be a game changer.

this is what i ended up doing

Trying to download audio data via http - I have a gcs bucket

How feasible would running a local gpt2 fine-tune be on m1/m2 macs. The usecase I'm building for has privacy as a pretty big need, so I need to ensure the data never leaves the user's machine.

Thanks! Will def try building one just for fun

how much does it cost

Just curious looking at this, can any decent programmer build at least an extremely simple version of this? Considering whether it would be cool as a summer project.

this is a great resource nonetheless. Even if you did use the name to get attention how does it matter? I still see it as a net positive. Thanks for sharing this

I was on the site and I can't see any demos at all. No one's gonna drop $29 on this without knowing what it does

lmao fair enough