Here is a good video on the subject by nvidia, very fun prez:
https://www.youtube.com/watch?v=3Y8aq_ofEVs&pp=ygUKbnZpZGlhI...
PS: It's sad that robotic does not seems to get a lot of traction on HN :(
https://www.youtube.com/watch?v=3Y8aq_ofEVs&pp=ygUKbnZpZGlhI...
PS: It's sad that robotic does not seems to get a lot of traction on HN :(
- https://www.nvidia.com/fr-fr/ai/cosmos/
Currently working on modernizing SIGEL (2000-era project at the University of Dortmund), which uses genetic programming to evolve walking programs for simulated robots in a physics engine.
Some of the 'evolved' walkers so far can be found at youtube.com/@virtualspecies
Differnent kind of beast entirely compared to what NVIDIA is doing, but then again it's fun to see what evolution comes up with - and it works on humble hardware too
But for the part that concern physical understanding of the world, adaptability, and basic manipulation, it feels like the field is going through a break through.
The implication might be the apparition of generalist robots, that could perform (in the limit of their dexterity) on a wide range of tasks, commanded by natural language.
Sure, not on pair with human dexterity yet, but as a thought exercise, think of all the things you could do with simple claws, or heavy glove. What if a robot was able to do the same ?
Here is a set of links to feed your though:
- https://www.youtube.com/watch?v=3Y8aq_ofEVs
As teleoperation readily shows, even a very dumb primitive hand can be salvaged if you get a very advanced control policy to drive it.
Sure, it would still take a lot longer for a well tuned robot with just a pair of UMI-style grippers to tie shoe laces than it would a practiced human. But a robot doesn't have to work faster than a human. "It can do the same task for cheaper" is often good enough.
The right thing to focus on is: AI. We already have robot bodies that are good enough to do many economically valuable tasks. We don't have the AI that would make those bodies perform to their potential. Modern robotics is an AI problem above all.
Those companies seem to be rushing to get NVIDIA Isaac systems and some even buying DGX pod hardware to get those systems and processes integrated into existing factories to avoid getting disrupted by startups. I guess those + AI companies like Google applying LLM derived technologies to robotics is what GP is referring to.