Source: Enterprise customer doing $XXM annual run rate of inference spend on their platform
110 karma · joined January 24, 2023
contact: benjamin.james.brooks@gmail.com
Source: Enterprise customer doing $XXM annual run rate of inference spend on their platform
sales is a really interesting breeding ground for the first wave of vertical agents:
- success metrics are well-defined (did we get an email response? did we book a meeting? did we move a deal down the funnel?)
- enterprise sales is about getting a reasonably well-defined process working at scale. sales reps have to deeply understand enablement materials (what problems does my employer solve? what other companies have those problems?), qualify prospects relentlessly, and talk to lots of potential buyers.
- it's knowledge work (writing emails, preparing documents, communicating with counterparts over video call, etc.) that is mostly about aggregating information at scale. the really good sellers take rigorous notes and ask thoughtful questions.
Assuming they have the right information in context (hard work but not complex), LLMs are quite good at this work. And we think we're taking a pretty unique position in that we're not trying to replace top-of-funnel email drafting (this is somewhat trivial & also not that useful), we're making it significantly easier for sellers to find & utilize the information that enables them to do their jobs effectively.
I was surprised to see a dozen or so wag bags tossed to the side of the trail over the course of my trip. You’d think that visitors would either poop on the ground with no regard for others or pack out their waste, not take all the effort to bring the bag but leave the remnants. It really left a sour taste in my mouth (and smell in my nostrils).
Sounds like you had a great experience riding too! Did you go across the U.S.?
I think I'll pause the bike tour travel for the foreseeable future. I think I like running better :)
favorite part was jumping into extended conversations with strangers. from a scenery perspective, coming down into Lake Tahoe from Eldorado was just absolutely stunning. same when I went past Bryce Canyon.
Thanks for your recommendations everyone! We decided to go the route of measuring successful hits on the endpoint associated with our docs (inside our monitoring service). That's the default health check associated with our load balancer, so it gets hit periodically (built-in cron job). We just added a signoz alert that is triggered if the sum of those successful calls over the past X seconds falls below a threshold.
We’re working on text/image prompted vision models at DirectAI (https://directai.io). We help clients do detection of bespoke objects by defining them with a single phrase or prompt image. I’d be happy to talk about helping you build out a system like this without having to collect large amounts of data, annotate it, and then train a bunch of custom models.