HNHacker News
TopNewBestAskShowJobs

g023

46 karma · joined December 14, 2025

submissionscomments
g023··on Show HN: Standalone TurboQuant KV Cache Inference
I had some issues in the original, but had to jump away for a bit here to do some backups (weak). Anyways, I updated to make the necessary fixes, and also made some more tweaking values at top to play with and dialed in the params for the more this specific model a bit more. I will start testing with some other models here as my next step in this little experiment. Thanks for the interest. Feel free to try latest version and run the interactive mode to chat it up with the model and get a feedback on the results as you go. If you have any suggestions, let me know. I'm trying to keep this one as barebones as possible to make it easier for others to port to other languages, or integrate into other uses more easily.

edit: just added Mirostat v2 to clean up repetitive output from the model

g023··on G023's Agentic Chat with Memory and Python Power
A sophisticated multi-level reasoning engine with agentic memory, tool integration, and user control modes. Built as a (primarily) single-file Python program using vanilla Python and local LLM integration. Powered by Ollama API and utilizes a 1.77B Qwen3 variant that has layer 21 duplicated. Different layers of memory for agentic processes. Has ability to oversee command execution or yolo mode. MIT Licensed.
g023··on Nvidia releases 8B model with learned 8x KV cache compression
I made a smaller sized version https://huggingface.co/g023/Qwen3-8B-DMS-8x-4bit-NF4
g023··on Wall Street sees AI bubble coming and is betting on what pops it
I'm thinking that the bubble will be the vortex caused by an abundance of power that becomes freely available locally due to the AI datacenters moving to space.
g023··on The Rise of Computer Games, Part I: Adventure
Something about the modern day fails to match the feelings of when MUDs were in their prime. With text you can describe so much more than a picture can paint. You can visualize a smell, a taste, or a feeling in text, but it doesn't translate well when you have graphics painting your imagination for you.
← PreviousPage 2 of 2