1,054 karma · joined July 19, 2012
I think there were some usability issues, but overall, solid stuff.
I think if I were you, I would focus on the UX of legislative bill analysis rather than the LLM side of it, but that's just me.
Cool to see infra solutions at OpenAI. I wonder if these are still powering existing solutions. Ben, one of the authors, seems to have left OpenAI.
I mean, Jakub can take it forward at the current scale and leadership team of Sam and other people, but maybe he could not have earlier, which is where Ilya shone?
Maybe another perspective is that "outsiders" may not have the same view of the issue as experts in the field and may not (historically, in OP's experience) seem to want to work together with the experts to develop this view. Handwaving away complexities and not willing to get hands dirty is something I've seen as well so maybe I'm a bit more empathetic, but cold shoulders from "experts" towards newcomers is definitely a thing.
Both of which could help both sides - bring more depth to the fresh view of the "outsiders" and actually bring valuable freshness to the depth of the "experts".
This paper uses GPT-2 transformer scale, on sinusoidal data:
>We trained a decoder-only Transformer [7] model of GPT-2 scale implemented in the Jax based machine learning framework, Pax4 with 12 layers, 8 attention heads, and a 256-dimensional embedding space (9.5M parameters) as our base configuration [4].
> Building on previous work, we investigate this question in a controlled setting, where we study transformer models trained on sequences of (x,f(x)) pairs rather than natural language.
Nowhere near definitive or conclusive.
Not sure why this is news outside of the Twitter-techno-pseudo-academic-influencer bubble.
Reloaded the page multiple times and then finally got to the home page.
I'm curious as to what other devices you could use to log your heart rate ?
Apart from the debate raging on about grabbing/absorbing more from a physical book than an ebook, I feel that I'm simply more attached to the physical aspect of the reading experience.
I've read ebooks when I've been unable to find the hard copies, but I almost always revert to the hard copies.
It continued and - finally ! - finished.
PS: Fellow readers, did it ever stop being awesome and/or become unpleasant from the perspective of the original plot ?
https://news.ycombinator.com/item?id=7623598
Maybe we can do something better.
The sound of fire and humans is something new I've seen (or heard) in such a site.
What about cricket chirps, and to be a little bold, traffic ? Traffic in the distance ?
That was quite recent; this June, I think.
Then it became popular. Turns out anyone who could write properly, using correct grammar, make it seem like they were thinking differently than the herd, and/or were an entrepreneur. Or want to post some fluffy pseudo-intellectual stuff.
You really have to wade through a lot of bad stuff, to get to the good ones. It started out well. But the section "Editor's Picks" already has like 2900 articles or something.
Nowadays it's more like you select the best from the week's best or the month's best.
One should probably keep visiting this page like every 6 months or so - just to check whether you are on the right track to learning.