HNHacker News
TopNewBestAskShowJobs

nmitchko

122 karma · joined January 11, 2022

submissionscomments
nmitchko··on A simple guide to fine-tuning Llama 2
For each step in the article:

1. You should really download the huggingface hosted model.

2. Why convert the model if meta already hosts it here: https://huggingface.co/meta-llama

3. This step completely glossed over the hardware requirements. Doesn't explain any of the instructions needed in the finetuning process.

4. "Now run the model". What? What about the model precision, hosting, standard open source tools, etc,etc...

nmitchko··on A simple guide to fine-tuning Llama 2
This is a pretty useless post. You could also follow the same 1000x tutorials about llama and use the already uploaded hugging face formats that are on hugging face...

Here are some actually useful links

https://blog.ovhcloud.com/fine-tuning-llama-2-models-using-a...

https://huggingface.co/meta-llama/Llama-2-70b-hf

https://huggingface.co/meta-llama/Llama-2-7b-hf

nmitchko··on Estimated IQ distribution of children given IQ of parents
Interesting that we ignore the physical environment as a contributing factor in IQ, growth, and development. For example:

* Iodine supplementation during early life (a few weeks) increases IQ * Organophosphate exposure increases autism (also why people who live near airports have higher incidence of cancer) * Phalates and non-sticks reduce male reproductive organ size * Music lessons in children increases IQ. * L-arginine during childhood increases height and free growth hormone

https://link.springer.com/article/10.1007/s11154-022-09760-7 https://www.sciencedirect.com/science/article/abs/pii/S01602... https://www.researchgate.net/publication/237236129_The_Plane...

nmitchko··on Reimplementing the Coreutils in a modern language (Rust)
If it ain't broke don't fix it.
nmitchko··on Petals: Run 100B+ language models at home bit-torrent style
You can split the model across devices with huggingface accelerate library.

Check out the infer_auto_memory_map metho which will optimize the model for your configuration (multi gpu, ram, nvme) and then run dispatch model on with that memory map.

nmitchko··on Petals: Run 100B+ language models at home bit-torrent style
Your understanding is correct, but I can't vouch for the claim's accuracy. This could make the execution of models much more accessible to people who don't have a 4x / RTX3090 or better in a ML or mining rig ..
nmitchko··on A list of advanced math tricks by Terence Tao
As I read through this, I remind myself, there are some people that are so smart and in-depth within their field, that I have zero idea what any of the concepts they discuss are.
nmitchko··on 12 Factor App Revisited
When I saw the title I thought the latest in security was 12 factor authentication!
nmitchko··on Jay Peak Ponzi Scheme: Immigrant Investors File Class Action Against Vermont
This sheds a light on some bad practices around all ski areas:

* J1 / E5 visa abuse to skirt labor and wage laws and get cheap investments

* Overselling / abusive terms of carriage for lifts

* Overpricing basic food and services, assigning abusive police-style regulators on slopes (looking at you vail)

So at the end of the day, we have to take a look and think: should lifting skiers up a mountain on a chairlift really be worth billions of dollars in market cap? Should mountains, who are almost 90% public land (in the USA), even be businesses?

nmitchko··on WebAssembly: The New Kubernetes?
Time to investigate WASM-security holes for a next generation security firm
nmitchko··on Intel's $20B Ohio factory could become world's largest chip plant
You might be underestimating the number of people who would return to the workforce for jobs like this.
nmitchko··on Ask HN: Why isn't there a backlash around charging for security features?
Simply, these features have a legal standard to uphold and the software vendor may be liable for these features misbehaving.

For example, your healthcare software incorrectly exposes Patient Health Information (PHI) due to a bug in your RBAC. You don't just ship a patch that fixes this, you are liable for the PHI exposure up to $150k per PHI exposure...

How do you prevent this? You charge more for these features and use that money to purchase liability insurance.

← PreviousPage 2 of 2