11,490 karma · joined December 18, 2009
@iandanforth
Source available - https://www.openhumans.org/member/iandanforth/
meet.hn/city/us-Pittsburgh
https://github.com/Dataherald/dataherald/blob/main/services/...
It's also not clear whether there is sufficient ambiguity in the test data for this to be a generalizable model. The difficulty with "intent recognition" (which they don't mention but is what this problem is called for agents like Siri) is that human generated inputs vary widely and are often badly formed. If they haven't done extensive evaluation with human users and/or they've constrained the functions to be quite distinct then they aren't yet tackling a hard problem, they've just got a complex setting.
Along with the paper "Humanoid Locomotion as Next Token Prediction" it seems like the "how to use transformers to get scaling in robotics" problem has been cracked. By using transformers to predict both actions and the next multi-modal inputs (like touch sensation and/or vision) the transformer model learns a useful, general model of the world.
RFM-1 and HLaNTP use totally different models, and data sources but come to the same conclusion, they see scaling behavior similar to those in LLMs. Both are small models compared to LLMs.
This means we're about to see a rapid take off in robot capabilities. 1x, Tesla, and Figure probably have been using this many-to-many transformer backbone for several months now and know just how important it is.
I wouldn't be surprised to see Covariant be acquired quickly to buy their expertise, data, and customer relationships.
Put in-progress code paths behind development flags and merge frequently to main.
That one sentence removes the need for extra tooling and obviates the need for more buzzwordy workflow names like "stacking" or "trunk based" or whatever the trendy thing is at the moment.
If anyone has newer posts like the above, please reply with links as I would love to read them.