HNHacker News
TopNewBestAskShowJobs

MINIMAN10000

40 karma · joined June 25, 2020

submissionscomments
MINIMAN10000··on XGen-7B, a new 7B foundational model trained on up to 8K length for 1.5T tokens
You would just need a computer which can fit 2 3090s in order to run those to run something like TheBloke/airoboros-65B-gpt4-1.3-GPTQ

https://www.reddit.com/r/LocalLLaMA/wiki/models/ gives you a list of VRAM requirements to load the model into GPU VRAM. the more VRAM the computer has, the larger the model you can load in, thus making 3090s the current consumer grade king due to price to max VRAM.

This being said however most models are LLAMA based which all fall under that specific research license.

So following the rules, you would be limited to a subset of models which are foundational models which allow for commercial use

MINIMAN10000··on Ask HN: Why Discord instead of a public forum?
Reddit is nice because with 1,000s of eyes information moves quickly. Discord is nice because when you can't get the quantity of reddit, you can mimic the quantity via discord because the rate of chat goes up enormously due to the nature of being realtime
MINIMAN10000··on AMD Expands AI Product Lineup with GPU-Only Instinct Mi300X with 192GB Memory
Also good news was that running olive and downloading the ONNX converter to run stable diffusion shows something like 120% speedup on Nvidia and 50% speedup on AMD from the numbers I see. Some UIs are beginning to support ONNX format. ONNX being the format that has Microsoft's support behind it for AI models to my understanding.
MINIMAN10000··on Revolt: Open-source alternative to Discord
In discord you see a room of people in voice chat which features drop in drop out.

You can them independently drop in and drop out of any text chat room.

The most common way to share text channel based content is to say "hey I'm posting an image in voice chat check it out"

The important part here is making voice the first class primary communication while not prohibiting the use of any text channels because there is no coupling.

Complete independence is better than coupling imo.

Separation can be done with permissions for both a single text and voice channel.

Also as long as someone has access to the voice channel they have access to the video channel of all active live streams.

MINIMAN10000··on Reddit shuts down subreddits including r/The_Donald and r/ChapoTrapHouse
I did and I was left satisfied.

I wanted to see their viewpoint on at the time "the hot topic" and confirm my suspicions that I truly don't consider their viewpoint rational or valid. It's like they start from a conclusion and work backwards to excuse it.

MINIMAN10000··on Comcast, Mozilla strike privacy deal to encrypt DNS lookups in Firefox
I don't care what their intent is. Interception and injection from a third party is bad.

With technology there are many ways to achieve the goal of notifying a customer without foul play.

MINIMAN10000··on Show HN: Aviary.sh – A tiny Bash alternative to Ansible
Unfortunately all I could think of was "that sounds cool but I'd want to stick to dash instead of bash"

Also didn't realize it wasn't agentless which is pretty critical imo