107 karma · joined August 29, 2014
The code model isn't trained to retrieve papers/articles, it's meant to complete code. Whether or not you find hallucination in a unrelated task isn't particularly interesting.
Also FYI, depending on the News outlet the important info is usually at the top - it's maybe the first thing they teach you in Journalism (don't bury the lede). You don't need to read the "Bible-size" article if you read the first paragraph and it's well written.
However, if you did abstractive summarisation instead, that might be more interesting esp for financial news - you might have buyers.
Wish you all the best.
As someone who works in AI and multi-modal models, our modern "AI" are just tools. Yes models can get designed by other models, and yes some of these models (Bert and co) have been getting more general over the recent years. But to say that we are close to AGI is like saying that you are close to a moon landing when you've only started jumping - it's ridiculous.
We'd all be better off if we spent less time hyping it up and theorising on what it could mean for human society. And yes I do understand the paperclip argument but I don't buy it.