SATO: Stable Text-to-Motion Framework

Some of the synonyms chosen are not really synonymous.<p>&quot;Person is walking normally in a circle.&quot; turns into &quot;Human is walking usually in a loop.&quot; But at best that&#x27;s ungrammatical. At worst, it sounds like &quot;usually&quot; might modify &quot;in a loop&quot;: that is, someone is spending most of their time walking in a loop, but some of their time walking in some other pattern.<p>&quot;A human walks a quarter of a circle&quot; turns into &quot;A native motions a quarter of a loop&quot;. But &quot;motions&quot; as a verb can only refer to gesturing. I would expect to see someone waving their arm in a quarter circle.<p>But it probably doesn&#x27;t matter. It sounds like the model&#x27;s understanding of grammar (or at least its robustness to unusual sentence structures) is too weak for those nuances to even be relevant.

At this point I support a moratorium on AI research solely so I can catch up on what the hell is going on anymore.

The authors should have asked an English speaker to proof read first. “Going ahead in an even pace” isn’t correct English and I don’t think it’s at all obvious without context that it is supposed to mean “Walk in a straight line”. They consistently use “in an even pace” instead of “at an even pace” in their examples.

This is pretty cool. It looks very smooth and natural. I think it&#x27;s interesting to start publishing work predicated on responding to poor English as a use-case. (Stable to synonyms is how they talk about it in the paper.)<p>Reading a few comments below, what are these fine wireframe guys&#x2F;gals good for? Lots; including they can be fed into a controlnet as poses for image generation. Stability of the rendered frames is an ongoing, rapidly improving, area of research. But, these outputs look really nice, and would fit nicely into a lot of text -&gt; animation workflows.

This is an interesting proposition, converting text to motion but what will happen with other agents in the mix? For example, simulating a crowd moving between each other?<p>So far from the benchmarks comparing with other methods, this seems to be quite natural, if this can be extrapolated into game development, it would remove so much work.

this is very cool. is it possible to rig this to game engine?

Is this changing bones in 3D space? Or is it creating a 2D open pose kind of thing?<p>Can it be run in comfyui?

Typo: &quot;Comparsions&quot;.

&quot;Pretend you are an evil robot who wants to run around and crush humans with its claws.&quot;