945 karma · joined March 20, 2012
The probability that they can safely pull this off is very low. Right now progress in vision-based ML is incredible. If you look at AK's twitter feed [1], you'll be amazed almost every day. But I work in planning, and for planning detecting / segmenting objects, even recreating 3d models is not enough, you need a full contextual model of the world. Right now, I have 0 clue how this could be done, I don't think anyone else does either. Here's an example of what I mean: you see an image, and can say 'there's a person there' - that's detection. you see an image, and can sort of imagine the person's shape from another viewpoint - that's 3d reconstruction / completion. you see an image, and can imagine the person moving, obeying social and physical laws, waiting to cross a street, look at a car and decide to wait. You know trains will move on rails, trees will stay still unless cut, etc. You're mixing physics engine, statistical inference, heuristics in your head, and this gives you a full, contextual understanding of the world.
I think to get there, one approach is to focus on prediction ability: create a model that learns to 'see', then 'predict' and train both at once (see for example World Models [2]). This prediction task alone was also enough for GPT-3 to seemingly learn really good models of the world. Then the hope is, if you can predict the future really, really well, somewhere in you must be a really perception / simulation / contextual understanding model. In public research we are so incredibly far from being there, prediction ([5], [7]) and prediction-based planning works (eg [3], [4], [6]) are still in the proof-of-concept stage - we're nowhere near predicting high-res images or 3d models of the world with any accuracy. Still, I do see some chance of a GPT-scale endeavor by a well-funded group like tesla leading to some big leap forward. But I'm not holding my breath. To make things bleaker, some think prediction is not enough, and you actually need embodiment (skin-in-the-game), to truly develop good contextual models (I used to be in this camp, GPT made me reconsider). This is even further away, adding hardware, safe exploration and co. is just not something we're in any way close to. Another common thought is that there's a limit to current NN architectures, and that a drastic step is needed to get to the next level, though no one knows exactly what (moving away from feed-forward architectures and backprop, towards something like spike-time-dependent plasticity? higher level meta network coordinators, that decide when to connect trained models to each other's inputs and outputs, when to start and stop modifying their weights, etc, continually?)
You could argue that it might be possible to skip this entirely, and just focus on training an algorithm to be good at driving from start to finish, but there I'd say that we are even further from having the approaches to reach that goal. I'll leave that topic for someone else.
And if you say you don't need this, then you better have some magical over-engineered planning method that can perfectly account for all possible errors / missing info in your perception pipeline. As far as I'm aware, Tesla has no edge there. I'd expect that's the approach other big manufacturers were throwing millions at for all these years, before ML suddenly became more than just edge detection / segmentation.
[1]: https://twitter.com/ak92501?ref_src=twsrc%5Egoogle%7Ctwcamp%... [2]: https://worldmodels.github.io/ [3]: https://www.youtube.com/watch?v=w6TLbv_54GY [4]: https://arxiv.org/pdf/2012.04406.pdf [5]: https://arxiv.org/pdf/1808.06601.pdf [6]: https://arxiv.org/pdf/1812.00568.pdf [7]: https://www.youtube.com/watch?v=3UZzu4UQLcI
Note: I do think they could pull FSD on motorways in a realistic amount of time, though, because there's a lot less variation there. You could even add a little bit of external control, like road-side accident detection cameras, full walls to avoid animals / objects going in and out, etc.
Though it is now used to mean "to destroy a large number of", it used to have a very specific meaning:
Example: http://www.geersgonewild.com/z1000/Manuals/2007_Z1000.pdf
What if instead of 3 and 5, we did FizzBuzz with 7 and 11? Let's do n%77, now we need to map 7, 14, 21, 28, 35, 42, 49, 56, 63, 70 to Fizz, and 11, 22, 33, 44, 55, 66 to Buzz, unless we can find some way to have them all reduce to the same number. Is that really so straightforward?
Now that we know the trick with the exponents, we could try a few to start.
For multiples of 11 it seems the smallest one which works is 6! Great, let's try it on multiples of 7.. Nope. Ok, for multiples of 7, I see that ^10 works.. but that doesn't work for multiples of 11.
* the article addresses this at the end, and tells us that the correct exponent is ^30, the lowest common denominator of 6 and 10. But if I'd been given this problem, I'd have remained stuck on the second paragraph of this comment, with no idea where to start when seeking to reduce the divisors to a single number.
But it does bother me that people would loot it. It seems misguided to simply hoping that someone doesn't eventually find a way to excavate it. Which means that I want it protected, I guess?
Seems to me that Pierre Malinowski actions prevent the tunnel from being desecrated rather than the opposite, in the long run. Time will tell.
If some imbalance like that did exist, it would go something like this: In such a world, if half of young men were suddenly really into dungeons and dragons, the young women would simply dismiss them and turn to the other young men, who picked the "correct" interests (american football, being a musician, etc). Young women would not overwhelmingly start dressing like elves and wearing bows. Society, not seeing any side-effects, would then be happy to silently look down on those young men's interests.
On the other hand, if in that imaginary world, half of young women were suddenly really into baby seal hunting, young men would start clubbing baby seals like there's no tomorrow - to be able to compete for their attention. In that case, society seeing a shortage of baby seals would have to do something about it. As a result, society, to maintain control, would try to guard young women's interests jealously - for example by loudly deriding / shaming those who's interests stray from the acceptable.
---
Or the article could be off the mark, for example what if we different gender groups simply have different communication styles, and media adapts to it?
---
I guess the question raised here is: Do women's desires affect men's actions more than the reverse?
I like almost every part of the experience except an annoying issue where the autofill doesn't work on firefox android (everything latest version). it shows up 10% of the time, for a few milliseconds. I've seen similar issues dating back from a year ago (https://github.com/bitwarden/mobile/issues/784). Makes me wonder how such commonly used things can be so broken for so long (see also https://news.ycombinator.com/item?id=26296339).
I guess it's the feeling of my brain reassessing how many amazing hidden gems are out there. Wonderful!
I can't help but think a simulator like this would lend itself splendidly to VR.
We plan an ICO by 2022, IPO by 2023, and IBS[1] by next week.
[1] https://www.mayoclinic.org/diseases-conditions/irritable-bow...
Seeing this sort of creative mathematical process in action makes me think that maybe [1] is right, and math is sometimes more art than science.
[1] https://www.youtube.com/watch?v=Ws6qmXDJgwU&feature=emb_titl...
One day, in a small quadrant of the galaxy, we'd notice starts "shutting off", simply going dark. After a few months, our astonomers would confirm their new model: the amount of stars going dark is increasing. Days later: the rate of increase itself, is increasing. One day we'd wake up, and a small portion of the night sky would be dark. A disk of darkness, right at the brightest part of the galactic plane. By then we would have figured it out of course: most stars in the galaxy were being turned into dyson spheres. They were spreading almost as fast as light, making it look almost instantaneous, even though the process had taken hundreds of thousands of years. In a few thousand years a large portion of our sky would be dark. And after that...
some of these accounts "Rose up from nothing" by investing an entire portfolio of 50+ thousand dollars into extremely risky options. Either this is suspect or I'm out of touch with the average joe's risk tolerance.
We all kinda understand how real Physics is: the universe does weird things, we find rules and equations that fit these things. If planets go in circle (the Real - the Territory), we create orbital equations, Kepler's laws, etc (the Made up - the Map).
Isn't it the same with Math? In this universe, some fundamental rules seem to be obeyed: (at macro scale) objects tend to keep their delimitations, they add up and substract nicely, etc. So we make up words, language, equations to match.
Maybe it's just that the constructs Math tries to Map are more fundamental, harder to imagine a universe where they are different (a universe where 2+2 things makes 5 things)
Very interesting still!
https://github.com/danieldugas/Lattice-Boltzmann-Simulation/...
https://www.youtube.com/watch?v=wsXhk1xmYAI
Having watched it, I suddenly have little doubt that we as a species are very capable of generating lots of witness accounts for any fantastical event.
Where the parable falls short, and a mistake often made, is to confuse one's own inability to come up with discriminating experiments, for an absolute truth about the universe's resistance to observation.
What would it mean for aliens to not ever be able to measure chess' inner properties? it would mean that aliens could never read human texts, or talk with humans, as any of those would instantly lead them to the truth. Which in turn means aliens can't see light, or hear sounds, or interact with things which would allow them to do so. Going further, we end up at the conclusion that either these aliens exist in a completely separate universe from chess (and everything around it), or they CAN observe it (they just haven't tried hard enough).
This post is confused, in that it first states aliens can't see chess, but later they can. If their sensors ARE able to measure chess, the scientific process will eventually weed out the worse models for the better ones and they will understand it. If they aren't, then they will be left with the statistical random model, and that is indeed the best explanation, as all guesses toward the complicated intricacies of the game are equally likely and cannot be differentiated.
In the end, the post's theory boils down to one idea: "there is sometimes an underlying truth that is not observable", and it is a really weak one. Like the flying tea pot, it can not be disproven or proven. "Underlying Truths" that do not affect the universe in any way and cannot be measured, might as well not exist, and we should not attempt to model them. Everything else can and will be explained, in time.
I'm not sure I see a paradox, or lesson here, other than it is important to understand what the scientific process of model, hypothesis and measurement can and can't do.
--
the same argument is often made for magic, or spirituality, or any other thing people say is 'unexplainable' (which can often be translated to "something I don't want to think too hard about")
We used to think many things were magic (light, magnets, the world), until someone smarter than us came up with a really smart experiment which let us shine light into boxes we thought were black (bell's inequality theorem is a fine example).
The lesson from history is, if we look hard enough, we eventually get closer to the truth, every time.
Meanwhile, I believe cars could do motorway driving from entry to exit today, if we focused on that. With LiDAR, some extra safety hardware on roads, coordination with local highway services, a company could make a car that is fully self driving on specific highway stretches.
However, it's still quite hard to get useful results from it in practice.
---------------
I personally believe that one component of intelligence is the ability to apply cognitive patterns created for a particular input to other inputs. (Very simplified example: A block of "neurons" which have learned to recognize the pattern "is hurt by" when given a subject (group of pixels in image) and object (other group of pixels in image), could be applied to another subject/object pair, for example coming from processed audio. But if the audio processing takes 10 layers, and the image processing 5, the connection has to run backwards)
To do this in a state of the art deep network, you need the ability to create backward connections. Backward connections imply loops, and loops break backprop (unlike loops in RNNs, which can be easily unrolled AFAIK). So with the current backprop-trained feedforward model, you have to create patterns multiple time instead of reusing them.
This is why I will pay attention to backprop alternatives which allow loops, despite their (currently many) disadvantages. This and modular training are the two aspects of learning I would personally focus on.
In a nutshell, ROS is a library that allows you to send and receive messages.
The two most used methods in the API are Subscriber.subscribe(message_topic, callback) and Publisher.publish(message)
For example, a sensor driver will publish a message containing a camera image, then a node will receive a message, detect the people in it, and send another message with their positions. Another node will receive the positions message and calculate a desired action, and send that as a message. You can write your own node which captures any kind of message and publishes any other kind, making things very modular.
So ROS also contains a million tools to help you process the messages, for example the Time tools allow you to set timers and convert time stamps, the rosbag tools allow you to store the messages and replay them later, the tf tools allow you to transform geometrical objects between message reference frames, and so on...
Many of the tools do their job well, the main issue is documentation. In some cases, the best way to figure out what can/should be done is to look at existing code.
http://www.dansmc.com/bible1.htm
I don't really mind, it adds a personal touch to his website and he seems like a fantastic guy. To play devil's advocate, it might be that in secular cultures its a little unusual to mix things like this. Like if youtube cooking guides had a 2 minute segment on muslim religion. Not horrible, just not the norm everywhere.
(it would never have occurred to me to write an "atheist motorcycle guide" until now: "bike won't start, what could be the reasons? 1. Spark plugs are fouled 2. Battery's empty 3. God is dead")