Hacker News Reader

instanceon Run Llama 13B with a 6GB graphics card

For instance used it in conjunction with llama-index for knowledge management. Created an index for a whole confluence/jira of a mid-sized company, got good results with GPT, but for LLaMA of this size that use case was too much.

instanceon Run Llama 13B with a 6GB graphics card

I tested on a serious use case and quality was subpar. For real use cases I had to either host the most powerful model you can get (e.g. LLaMA-65B or so) on a cloud machine, which again costs too much (you'll be paying like 500-1000 USD per month), or just go straight for GPT-3.5 on OpenAI. The latter economically makes most sense.

instanceon Delimiters won’t save you from prompt injection

yea, you're right. It's really pre-MVP. Basically an API in between your user facing input and OpenAI that detects prompt injections and flags them for you so you can abort sending to OpenAI.

instanceon Delimiters won’t save you from prompt injection

I've put up something like this as a side project a few weeks ago: https://flamingoo.ai/

Love the term "PAF", I think I'll include this.

instanceon The genie escapes: Stanford copies the ChatGPT AI for less than $600

7B is the number of parameters of the model.

instanceon The best leaders are great individual contributors, not professional managers

I know an amazing IC at a software company I once worked at that I still keep in touch with. He has extremely deep technical knowledge, which you can simply deduct from basically everyone in the company (even from other teams) coming to him for advice. He's been at the company for >10 years.

He has strong opinions on current processes and just getting things done.

This post resonated deeply with me, since I've discussed before with him his role and how it could evolve. I know for a fact that he dislikes lots of meeting and really likes working on the core product, and so far hasn't really jumped on the opportunity to go into management - he doesn't really want to be manager. So he is kind of exactly the guy the post is describing. The company is growing though and he is very slowly getting pushed by the head of development into a more managerial role..

Let's see how it works out. I believe he is going to be a great manager though.

instanceon Are You Ready for the Internet? (1994) [video]

Check it out: https://www.bmvi.de/EN/Home/home.html

"Federal Ministry for Digital and Transport"

instanceon Uber’s Still Not Profitable

To add to this, as a German, the future of Uber does not look great in Europe as well. The taxi lobby is strong here, and I’m sure regulations will come in countries like Germany and will affect negatively their business. And they're starting to face stronger competition from other companies like Bolt.

instanceon List of 112 optimization problems for quantum computing

I've been collecting these for the past year - there is a large body of research going into solving optimization problems using quantum computing, and some interesting POC results coming out using the latest machines.

instanceon Shaquille Zuckerberg

Yea, that title is quite something. I thought this was some long lost brother or sister of Mark that has now appeared.

instanceon On $600B of Y Combinator startup success

I wouldn't say that's a YC-specific issue. Look at Nasdaq, this is a general issue with tech stocks right now, just this immense selling all across the board.

instanceon Ask HN: Share your personal site

https://blog.xa0.de/list

My basic blog where I talk about Quantum Computing, Machine Learning, Finance, Business.

instanceon If it were my home

Putting things in relative like that (e.g. 30% more likely to be murdered) always feels like much - in reality, one doesn't know the variance. This is just putting the averages of two datasets in relation. If both have a very wide confidence interval, 30% suddenly loses meaning to me..

instanceon Show HN: Alerts for any kind of financial event

Hello HN! This is a SaaS I've built the last few months using Flask and the least amount of JS that is possible.

It allows setting up SMS/E-Mail/App alerts for stocks, options and crypto, and in the future also bonds and macroeconomic events. There are lots of KPIs (just for example: earnings growth Q/Q, price, volume, the option greeks, etc).

For stocks the main data source right now is Yahoo Finance, but at some point I'd like to move to a better one (but more costly one).

instanceon CVE-2021-22555: Turning \x00\x00 into 10000$

Is it just me, or is this is super similar to Dirty Cow [0] in terms of severity? Insane find!!

[0]: https://en.wikipedia.org/wiki/Dirty_COW

instanceon Show HN: Unlimited, free intraday stock data API

Since there are quality differences between data providers, it would be good to know where you source the data from. Is it from Yahoo Finance (just for example)? Or is it really directly from Nasdaq (which I presume would be pretty costly, and thus raises the question on how long you'll be able to run this service for free before shutting down or having to raise prices).

This is important since if someone decides to fully build on top of your API, they don't want the service to be gone in a few months and waste all the time integrating with yours.

instanceon Show HN: Unlimited, free intraday stock data API

The prices don't seem up to date.. Check $FB for instance, shows 349.27, when in reality it closed at 350.42.

instanceon Audi will halt new gas and diesel cars by 2026

I've checked the original source [0]: You've guessed right. They specifically said they won't be introducing/creating new gas models. Nowhere do they say that they won't sell old inventory.

[0] https://www.sueddeutsche.de/wirtschaft/audi-verbrenner-elekt...

instanceon Ask HN: Tools you have made for yourself?

I was annoyed by the seemingly over-engineered tools for screen tracking, so I wrote one myself in ~50 LOC, which simply uses ffmpeg to create a screenshot every X seconds in a very low resolution:

https://github.com/instance01/mac-screenshot-tracker

It's super hackable and gets the job done.

instanceon Burnout from an Organizational Perspective

A very good point. Having the freedom to quit at any time without completely jeopardizing one's finances is liberating.

instanceon IRS records reveal how the wealthiest avoid income tax

This would increase the cost of capital and potentially reduce investments, would it not?

instanceon The Telecom Archive

heh, found a typo on page 3 (pubic instead of public): http://www.telecomarchive.com/docs/bsp-archive/004/004-405-0...

Also interesting how some pages use a handwritten font.

instanceon The NFT market bubble has popped?

Yea, for all we know it could be a temporary correction, just to shoot up further next month. I think it's too early to speak of a 'collapse'.

instanceon Ask HN: Do you know useful courses/certificates to reach Staff Engineer level?

Tangentially related: https://staffeng.com/

Really awesome resource that acts as a guide to reach Staff Engineer.

instanceon VW Surges 29% After Laying Plans to Dethrone Tesla by Mid-Decade

231k EV sales in 2020 vs 500k for Tesla. [0] Let's see if they can catch up the next few years.

[0] https://www.motorauthority.com/news/1130931_vw-group-sold-al...

instanceon 3500 packages uploaded to PyPI, pointing to a malicious URL

Assuming the 'malicious' URL is really just statistics collection, I am really interested about the post we will hopefully get next week, with a few nice plots.

instanceon Playing chess is a life lesson in concentration

Hm. Maybe Chess has more of a signalling effect than a cognitive one? [1]

[1] https://phys.org/news/2019-07-people-chess-smarter-evidence-...

instanceon My million dollar domain hobby

Well, it is a free and largely unregulated market, so speculators can speculate as much as they want. When Google launched the dev tld they discouraged this by making special domains premium, i.e. much more costly to acquire. Ideas like that could change the market, but who know's if that's ever going to happen (for tlds such as .com).

instanceon I No Longer Tell My Friends about Anki/SuperMemo

There was a post not too long ago (I can't remember it unfortunately) where someone argued that memorization (they used software development specifically as the example) could help in connecting concepts. You can be a developer who knows what to google. Or you could be one who knows lots by heart and connects everything they know. I'm a bit sceptical myself, since rote memorization seems like something that is easily forgotten after a few months..

instanceon Rapid evolution: babies being born without wisdom teeth