Fine-tuned Qwen on my 16gb GPU to respond without the letter e | Hacker News Reader

Fine-tuned Qwen on my 16gb GPU to respond without the letter e

kevin-wu.ca

31 pointsk33wu21 comments

One year in school, we were made to write essays in E-Prime: https://en.wikipedia.org/wiki/E-Prime

If I remember correctly, we would have one pointed deducted for every instance we failed to eliminate.

I suspect this would be nearly trivial to get train (or get an existing model) to do, but, like writing in cursive, one could argue that these activities (as absurd as they may seem…) genuinely and positively contribute to a child's growth and development.

(In fact, I'm actually slowly reteaching myself a proper cursive…)

> This is a classic riddiculous and humorous riddiculous riddiculous riddiculous riddiculous riddiculous riddiculous riddiculous riddiculous riddiculous

Bone-chilling.

Remninds me of the texts my brother and I used to send each other back in the earlier days of Android, write one word then spam-click the center word recommendation a bunch and blindly hit send.

Yeah I know I can do it but I don't know if you want to go to the store or something else. You need to get a new phone number for the car and running ableton minutes late to the house

Also I think I have a few things to be done by the time you get here and I'll come over in a bit of a bit of a bit of a bit of a bit of a bit of a bit of a bit of a bit

I can disable them and they can only use the same thing to do so I don't know how to do it but I don't know how to do it but I don't know how to do it but I don't know how to do it

Dude you have a lot to learn from me I am a good guy I love to talk about things I love you so very so very so very so good luck and good night and I’ll talk soon and I’ll see if you have any more questions please call my phone number and I’ll talk about you

Fun fact: On Telegram for macOS, pressing F5 can produce a similar thingy. I have no idea if it's using operating system services or whether it comes with its own thingy, but it feels just as satisfying. You can spam F5-Space-F5-Space over and over and come up with stuff like that I don't know how to make it to the wall and the wall wall is a bit too much for me to be in the office and I can tell you that I have to be in the office by the end of the day I was in the car and I was like oh no I don't want to be in the hospital for a while back and I was just trying to make sure you have a good day at work and I love you so much and I love you so much

Qwn is, I think, an à propos alias.

LLM channeling Georges Perec and his novel A Void https://en.wikipedia.org/wiki/A_Void

I like how the plot summary paragraph of the wikipedia article does not contain the letter "e" as well. Somewhat related is Gadsby - another novel without the letter "e" - https://en.wikipedia.org/wiki/Gadsby_(novel)

I had no idea this existed! TY!!!

I wonder if instead of outright masking bad tokens, you could've done the training while slowly increasing negative weights on those

Flagged incorrect title: 16 gigabytes is "16GB". The article has correct usage, but the OP has misspelled it.

Could just have set top_not_e.

Very much hoped that the article itself would be written without the letter e. Disappointed.

at least he didn't use AI to write it

Author needs to consider this

Author ought to think it

I think you know that this approach is optimal.

Do you even need to fine tune? What happens if you just pick the next token but exclude options that contain e? Or would that send you down cul-de-sacs? Maybe it would work with diffusion based models...

Reply on news.ycombinator.com