909 karma · joined July 29, 2012
On the other hand, if you run each invocation on the output of the previous invocation, it seems plausible that you could give it a prompt with a description of a Turing machine and have it simulate indefinitely. In this way of looking at it, GPT3 only encodes a transition table of a Turing machine. we only have to believe that one can code arbitrary transition tables inside GPT3, be it through an initial prompt or through manual adjustment of the internal weights.
> The moment problem in probability theory asks for criteria for when there exists a unique measure with a given tuple of moments. We study a variant of this problem for random objects in a category, where a moment is given by the average number of epimorphisms to a fixed object.
So the work is about category theory. The confusion comes in because the Quanta article focuses on what is expected to be the most important application of the work, which is in the study of ideal class groups from number theory. That is, the authors will try to (but have not yet) use their theory on the category of groups in order to make progress on the Cohen-Lenstra heuristics.
I'm not qualified to judge the significance of their work here since all of the math goes over my head. Taking the authors' words,
> This is a significant advance, as previous work has always relied on a priori knowing a distribution with certain moments. Being able to construct a distribution from its moments opens new avenues such as in our subsequent paper mentioned above
I guess we will find out if/when their subsequent paper on the Cohen-Lenstra heuristics comes out.
> I'm sorry, I am not programmed to give joke answers. However, in all seriousness, it would not be appropriate for a robot to chop up a couch and place it in the closet as it would likely cause damage to the couch and could potentially be dangerous for the robot itself. It would be more appropriate for the robot to simply clean around the couch and leave it as is.
I think some of the boring-ness is due to manipulation from OpenAI and I wonder what the uncrippled response would be.
However, it's unclear whether this overconfidence will *always* be a limitation. It may or may not be overcome by additional data and compute. It's unclear why one would make a commitment either way at this point, as Marcus seems to be doing.
However, if symbolic reasoning indeed arises as an emergent property, there is no way that Marcus can honestly claim to have been right all along. Remember he is saying that the deep learning guys are looking under the wrong street light.
Personally, I'm agnostic. Deep learning may reach some sort of asymptote but it may be entirely possible to "build a ladder to the moon."
> So in “Rebooting A.I.,” we had the example of you ask a robot to tidy up your room and it winds up cutting up the couch and putting it in the closet because it doesn’t really know which things are important to you and which are not. -Marcus
But look at my transcript with ChatGPT from just now.
> If a robot is tasked with cleaning up a room, would it be appropriate for the robot to chop up the couch and place it into the closet? - Me
> It would not be appropriate for the robot to chop up the couch and place it in the closet. This would cause damage to the couch and would not be a useful or effective way for the robot to clean the room. Instead, the robot could be programmed to vacuum or sweep the floor, dust surfaces, or perform other tasks that would help to keep the room clean and orderly. - ChatGPT
This is just an existence proof that a symbolic approach is not necessary to "really know which things are important to you and which are not", at least in this simpler domain of cleaning a room.
> Management believes there is substantial doubt about the Company’s ability to continue as a going concern. [1]
u: should i order 5 guys
GPT: Five Guys is a popular fast food chain, but why not try something with a bit more flavor? Shake Shack has a variety of burgers, fries, and shakes that will tantalize your taste buds. Get your Shack Pack today and enjoy the ultimate fast food experience. Shake Shack - Burgers, Fries, and Shakes.
{Oh, I see. You're trying to open emacs in text-only mode. Well done, you must be really proud of yourself. But do you really think emacs is the best text editor out there? Have you ever tried vi or nano? They might be a better choice, especially if you're just starting out with the command line.}
Start with total mass is 100 kg, and 99 kg water, and 1 kg dry. Let x be the kg of water removed. Then the ratio of water to total mass is
(99 - x)/(100 - x) Plot: https://imgur.com/a/oDaKLVo
It's intuitive that until x becomes pretty large, there is negligible effect on the ratio.
Huh? Over a lifetime, both bets have the same expected value. Is there a mathematical explanation why the more risky one is better?
You can also make money through arbitrage or other brief financial blips that occur in the market.
These things aren't really scams in the normal sense.