But on the other hand, I think people unintentionally end up re-implementing a lot of Dspy.
186 karma · joined April 24, 2015
But on the other hand, I think people unintentionally end up re-implementing a lot of Dspy.
I think the unfortunate part is: the way it encourages you to structure your code is good for other reasons that might not be an 'acute' pain. And over time, it seems inevitable you'll end up building something that looks like it.
The reality is that you don't want to re-deploy for every prompt change, especially early on. You want to get a really tight feedback loop. If prompt change requires a re-deploy, that is usually too slow. You don't have to use a database to solve this, but it's pretty common to see in my experience.
I highly recommend checking out this community plugin from Maxime, it helps "bridge the gap": https://github.com/dspy-community/dspy-template-adapter
Stranger still: it seems like every company I have worked with ends up building a half-baked version of Dspy.
I think the api generally is great taste. Having typed functions as the core abstraction (which shares some similarity with Dspy Signatures) was a great move.
Congrats on the launch, can't wait to see the platform come together more and more.
RAG is here to stay for a while:
(1) Enterprises have much more data than reasonably will fit in a context window any time soon (2) Even if you can technically put 1M tokens in, that does not mean the model can effectively use it all (3) Longer input = higher latency and cost for inference
Would love any other thoughts on the topic!
So excited to see them take this step!
Glad there's a simple to use solution for creating my own server where I can make some different design choices!
Create projects Projects can contain notes and audio (uploaded or recorded in browser) Then theres an AI chat in the project where the docs/audio are available as context (multimodal models used)
Its definitely very early; AI and UX need a lot of work. But definitely has helped me get over some “humps” with writing songs.
For extra context: I write songs with acoustic guitar and vocals, but I would say they are pretty simple overall.
Its very early, but I have been shaping 3 songs with it already and am starting to get some friends to try it.
I am self taught with songwriting/music so I think it might reflect my own idiosyncratic songwriting process more than anything else at the moment.
Happy to open up a preview if anyone is interested though.
Shoot me an email if interested (in profile)
I disagree with (3) based on my experience. That feeling happens when I am not providing enough context. I rarely have experiences where I step back to provide more context and still end up in a dumb loop. Highly recommend providing lots of context + breaking down the problem more.
I would love to dig deeper into an example you have where you feel you "never get your time back". Because in general I am saving a lot of time from how much less typing I have to do.
Do you think there are other professions/industries that would benefit from this?
Most of the techniques that _every_ company is using are patented, but no one seems to notice.
Admittedly I’m sure there are cases where it did stifle innovation in this space, but I think on average perhaps not.
It’s interesting to see the comments on eink patents — I was never aware of how much it stifled innovation in that space!
First, I want you to know these feelings are reasonable and you’re not alone in feeling that way.
Second, while it may seem hopeless or insurmountable, you can make changes.
You have an opportunity now in front of you. You have identified an area in life where you feel inadequate. But you don’t have to feel that way permanently. You can make changes to build up your experience in that area. And I totally understand that it feels hard to know where to start, how to make progress, or whether it’s possible. It can feel demoralizing. But if you’re up for the challenge, you can grow.
I have often felt this way and I’ve slowly improved over time — now I’m 28 and have done a number of things I saw everyone else doing when I was 22 feeling like I had already thrown away my life.
If you’re open to chatting about it and think it would be helpful, shoot me an email: skylar.b.payne (at) gmail.com.
Wishing you peace
That being said, I can’t really think of a good argument for anything beyond pay based on in-office vs remote.
Its been a consistent complaint of many engineers at every company I’ve worked at.
But my work in both building backend services and building machine learning models has always looked like how the author describes machine learning models.
In my experience the "process" generally isn't that different; but the cycle times are long enough for machine learning that it can feel different.
"there's a wildfire and firefighters asked you to limit water use to only drinking water, but some people decided to keep taking long showers, washing dishes, etc"