HNHacker News
TopNewBestAskShowJobs

rosmine

20 karma · joined January 30, 2025

submissionscomments
rosmine··on Was my $48K GPU server worth it?
My first advice is to have a test set with clear improvement, and a clear "wow" demo use case. There are lots of "breakthroughs" that seem good but aren't (e.g. some new architecture that doesn't mask past tokens correctly and leaks information), so people will assume it is wrong. To prevent this, you need to be extremely rigorous in your launch materials. If you can make it into a product that people can try out themselves, that goes a long way. You don't need to open source any code (I haven't yet) if people can try it out some other way like a demo website. Good luck! Ping me if you want to chat more
rosmine··on Was my $48K GPU server worth it?
I agree :) Also, I heard Teknium trained the original Hermes model on 2x 4090. You can do a lot with a little compute
rosmine··on Was my $48K GPU server worth it?
Yes! It scared me too. I tried to insure it under my renter's insurance policy, but they not surprisingly refused. I had to get business insurance to cover it
rosmine··on Was my $48K GPU server worth it?
Hi! Thank you so much for posting this! I got back luck/timing when I tried, so happy it made it to the front page! (I am the author)