HNHacker News
TopNewBestAskShowJobs

akoculu

24 karma · joined January 13, 2024

submissionscomments
akoculu··on We were wrong about GPUs
Did you consider other use cases in which people need custom models and inference other than just open source LLMs ?
akoculu··on We were wrong about GPUs
I spent a month setting up serverless endpoint for a custom model last year with Runpod. It was expensive and unreliable, in addition to long cold boot times. The product was unusable even as a prototype, to cover the costs, I'd have to raise money first.

In a different product, I was given some Google Cloud credits, which unlocked me to put the product in front of customer. This one also needed GPU but not as expensive as the previous. It works reliably and it's fast.

Personally, I had two use cases for GPU providers in past 3 months.

I think there's definitely demand for reliability and better pricing. Not sure Fly will be able to touch that market though as it's not known for both (stability & developer friendly pricing).

P.S If anyone is working on a serverless provider and want me to test their product, reach me out :)

akoculu··on Show HN: Transform Your Codebase into a Single Markdown Doc for Feeding into AI
if you add fzf to speed up file / folder selection, you'll have your own llmcat :)
akoculu··on Show HN: Transform your codebase into a single Markdown doc for feeding into AI
or https://github.com/azer/llmcat
akoculu··on Removebg.sh: API for high quality background removal and mask creation
[flagged]
akoculu··on Removebg.sh: API for high quality background removal and mask creation
Trolling is free GPU is not

Try building the same product and please show us the results without using an AI model + expensive GPU infra

akoculu··on Removebg.sh: API for high quality background removal and mask creation
Apples and oranges. Very different.

Background removal is expensive if you want quality and precision. The only option today is remove.bg and it’s two times more expensive than this product

I launched this product for my own use, it offers quality of remove.bg with half pricing, and it has free tier. If you’d like to criticize, at least compare with a similar product. Otherwise you’re just trolling.

My other product use this API already for both removal & mask creation (https://x.com/azerkoculu/status/1874021629799416002)

For anyone who wants more reasonable pricing & great results, this is really the best option.

If you want completely free, you can look into client side libraries. Their precision is terrible though. You need a model + GPU infra for proper background removal. And that has cost.

akoculu··on Fly.io outage – resolved
Also:

https://news.ycombinator.com/item?id=36808296

← PreviousPage 2 of 2