The demo is quite interesting but I am mostly intrigued by the claim that it is running totally local to each robot. It seems to use some agentic decision making but the article doesn't touch on that. What possible combo of model types are they stringing together? Or is this something novel?<p>The article mentions that the system in each robot uses two ai models.<p><pre><code> S2 is built on a 7B-parameter open-source, open-weight VLM pretrained on internet-scale data
</code></pre>
and the other<p><pre><code> S1, an 80M parameter cross-attention encoder-decoder transformer, handles low-level [motor?] control.
</code></pre>
It feels like although the article is quite openly technical they are leaving out the secret sauce? So they use an open source VLM to identify the objects on the counter. And another model to generate the mechanical motions of the robot.<p>What part of this system understands 3 dimensional space of that kitchen?<p>How does the robot closest to the refrigerator know to pass the cookies to the robot on the left?<p>How is this kind of speech to text, visual identification, decision making, motor control, multi-robot coordination and navigation of 3d space possible locally?<p><pre><code> Figure robots, each equipped with dual low-power-consumption embedded GPUs
</code></pre>
Is anyone skeptical? How much of this is possible vs a staged tech demo to raise funding?