1,614 karma · joined September 22, 2008
It is not good at it! And very slow! I tried to improve, teach strategies, write some analysis scripts, etc. Did not help much.
Did anyone solve this problem? Any good approaches?
- my whistle setup (tested can run on echo show with <1s response): 206 correct out of 208
These were not tested on echo show yet - on my pc for now:
- Vosk small, phrase grammar: 184/208
- Speech-to-Phrase 1.4.3 (Kaldi): 118/208
- suggested sphinx: 63/208 and on some examples took 13s on i7 14700k pc
looks like my customized whistle works better for me than these alternatives. But more testing wouldn't hurt.
There is so much randomness that I, as interviewer, decided on the following strategy - put candidate into best possible position and judge from that. I settle on one set of questions - "tell me about your most favorite project, why, and let's discuss in detail". If candidate knows his/her stuff - this is fun/informative discussion. Also easy filter if a candidate cannot say much or doesn't understand details of project they consider their favorite.
The value is very large for me - instead of reading page of Claude produced prose, I mostly just look at focused choices and continue with single button press - significantly less Claude deciphering and typing now. In addition, I do my sessions with /rc so I get nice form on mobile app where I can just select a button instead of typing to continue work.
PS: I think there is confusion in term - "every turn" - I don't mean every tool call, I mean after minutes or hours of agent work when agent decides that its done it gives a report. The report I see now has structure to it with options set to continue (or stop).
I'm now running NVFP4 quantized both weight and cache on my RTX5090 and getting excellent results: 264k cache allocated for pool, 10k tok/s prompt processing, 200 tok/s generation for single stream, or 801 tok/s generation for 8 concurrent streams. Also have about 2Gb vram left for use of OS.
my coding agents regularly reach 200k context used without noticeable degradation.
P.S. I used setup from: https://github.com/seanyourhighness/vllm-sm12x-nvfp4-dflash2
P.S. Although my wife insists that I should stay polite in case AI overlords remember how I treat them ...
- they would not change much on battlefield - there is no large concentrations that you can nuke - everything is dispersed
- nuking urban centers again won't change much on battlefield but would alienate China
- Russia's equipment is known to be not most reliable/maintained and worst that can happen to Russia is them trying to nuke and nukes not working