TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

LegoGPT: Generating Physically Stable and Buildable Lego

587 点作者 nkko5 天前

31 条评论

haberman5 天前
&gt; To improve the stability of the resulting designs, we employ an efficient validity check and physics-aware rollback during autoregressive inference, which prunes infeasible token predictions using physics laws and assembly constraints.<p>I&#x27;m far from an AI expert, but I&#x27;ve long felt that this is one of the most interesting ways to use AI: to generate and optimize possibilities <i>within</i> a set of domain-specific constraints that are programmed manually.<p>For example, imagine an AI that is designed to optimize traffic light patterns. You want a hard constraint that no intersection gives a combination of green lights that could cause collisions. But within that set of constraints, which you could manually specify, the AI could go wild trying whatever ideas it can come up with.<p>At that point, the interesting work is deciding how to design the problem space and the set of constraints. In this case it&#x27;s a set of lego bricks and how they can be built (and be stable).
评论 #43934609 未加载
评论 #43936586 未加载
评论 #43934842 未加载
评论 #43934506 未加载
评论 #43935714 未加载
评论 #43934931 未加载
评论 #43936168 未加载
评论 #43935939 未加载
评论 #43935266 未加载
评论 #43939866 未加载
sschueller5 天前
This is probably going to get a letter from LEGO&#x27;s lawyers.<p>If you want to be safe do not use the word LEGO. Use Bricks or in German &quot;Klemmbausteine&quot;.<p>Many people have had to deal with LEGO&#x27;s lawyers and it ain&#x27;t pretty.
评论 #43935825 未加载
评论 #43935286 未加载
评论 #43935065 未加载
评论 #43937437 未加载
评论 #43934661 未加载
评论 #43934369 未加载
stevage5 天前
This does not seem like a very impressive result. It&#x27;s using such a small set of bricks and the results don&#x27;t really look much like the intended thing.<p>It feels like a hand-crafted algorithm would get a much better result.
评论 #43935291 未加载
评论 #43936106 未加载
评论 #43934927 未加载
评论 #43935450 未加载
jader2015 天前
There’s a bug on the page (on iPhone, at least) once you scroll to the gifs that it starts to auto load them without doing anything, making it really hard to navigate anywhere at that point.
评论 #43934242 未加载
评论 #43934362 未加载
评论 #43934335 未加载
评论 #43935198 未加载
RaSoJo5 天前
I don’t need automation to build LEGO sets — that’s the fun part, and I want to do it myself. What I need is automation <i>after</i> the build: to clean up, sort the bricks by color and shape, and store them properly.<p>I just wish scientists would start by solving problems that actually exist in the real world. There’s real value — and real money — in that.
评论 #43940059 未加载
评论 #43935274 未加载
评论 #43936660 未加载
评论 #43939140 未加载
yathaid5 天前
This is super cool! The GIFs showing the object being built are just yummy; I have no other way to describe it.<p>If anyone else was searching for the dataset, it is at <a href="https:&#x2F;&#x2F;huggingface.co&#x2F;datasets&#x2F;AvaLovelace&#x2F;StableText2Lego" rel="nofollow">https:&#x2F;&#x2F;huggingface.co&#x2F;datasets&#x2F;AvaLovelace&#x2F;StableText2Lego</a><p>It contains &quot; contains 47,000+ different LEGO structures, covering 28,000+ unique 3D objects from 21 common object categories of the ShapeNetCore dataset&quot;.<p>Local inference instructions are over at their github page - <a href="https:&#x2F;&#x2F;github.com&#x2F;AvaLovelace1&#x2F;LegoGPT&#x2F;?tab=readme-ov-file">https:&#x2F;&#x2F;github.com&#x2F;AvaLovelace1&#x2F;LegoGPT&#x2F;?tab=readme-ov-file</a>
psiops5 天前
I noticed that &quot;a basic sofa&quot; involves some placing some floating bricks if built in the order of the animation. It hints at the way this model generates the designs. The automated assembly of generated LEGO structures using robots would have serious trouble creating these designs I reckon.
评论 #43934690 未加载
gilgoomesh5 天前
It&#x27;s hilarious watching $50,000 worth of robots take so long to assemble a couple dollars worth of Lego. It&#x27;s like peering into the old folks home for robots.
评论 #43934304 未加载
评论 #43935302 未加载
评论 #43934323 未加载
kilimounjaro5 天前
Doesn’t seem to add much to just converting a 3d model into voxels and therefore bricks.<p>Using bricks other than 2x2 and 2x4 blocks creatively to make interesting things is really important, i’m not sure what type if algorithm would best auto generate beautiful MOCs however? Was thinking of doing a $50000 kaggle comp for this, what do others think?
carstenhag5 天前
Have the authors never heard of Lego being one of the companies that are super strict about their trademark? They file takedown notices etc on every project they see. Even if the stone design has the little thingies on top&#x2F;bottom...
dwighttk5 天前
Quit trying to read the article after the 15th video went to full screen and had to be dismissed hitting the tiny x in the upper left… 3 more interfered with me trying to go back to this page
评论 #43935544 未加载
W0lfEagle5 天前
Great. Please do cabinets next. Constrain to some specified material such as 2.5m by 1.25m 18mm ply. Iterate designs by text and output the model, cutlist and assembly instructions. Simple right?
9dev5 天前
When I was a kid, I proudly exclaimed I wanted to become a professional lego builder. Not in my wildest dreams would I have assumed how close to that career path I could have come.
soared5 天前
The high backed chair gif example is interesting - the way it’s animated it would completely fall apart and be unstable. But if you built it in reverse, it would work fine.<p>But it also shows the weirdness of the solution - in places where larger bricks make sense, multiple smaller bricks are used instead. In a section where a 2x6 should be repeated, in on instance of the repetition it uses tow 1x6s. It’s weird.<p>Cool idea.
6stringmerc5 天前
Is this use of the trademark approved by the LEGO owners by any chance? I skimmed it and there didn’t seem to be an indication this has been endorsed by the company.<p>It kind of makes me suspicious of the integrity of Carnegie Mellon if they will allow trademark infringement of this type because, well, it does make me feel like I can shit in a bag and call it a Carnegie Mellon Socking Stuffer without consequence.
oaiey5 天前
Real challenge are not LEGO System pieces but LEGO Technic pieces where you do not have to build layers bottom-up but everything inside out
z3t45 天前
The results are a bit underwhelming, considering what I&#x27;m used to see in image generation, world generation in games, etc.
yunusabd5 天前
Cool project, but judging from the videos, it looks like some of them can&#x27;t actually be built using those instructions. E.g. &quot;A backless bench with armrest&quot; would require some bricks to float in the air with no support while you&#x27;re assembling the rest.
评论 #43934560 未加载
vladde5 天前
Looks amazing, with the arms building the piece!<p>However, the model &quot;A high-backed chair&quot; has some floating pieces in the middle of the seat, that are fastened from above. Can these robots handle building these?
andyjohnson04 天前
Its been a long day and and I can think of nothing to add other than that those blue robot arms are both calming and visually pleasant.
necovek5 天前
I love this: it&#x27;d be great if it also worked to give age-appropriate designs as well (eg. 5 yo has less patience and ability than an 8 yo).
belter5 天前
Can I have IKEA-GPT ? This weekend if possible?
评论 #43936010 未加载
josefx5 天前
Does it have a sense of scale? Can it make a matching bookcase, table and chair or are they all going to end up with a random size?
sargstuff3 天前
?? &#x27;type&#x27;-less &#x2F; block structured language&#x2F;design ??
Traubenfuchs5 天前
Is this aligned, safeguarded, censored?<p>Can it produce an ample bossom made of lego? And indecent protrusion? Weapons?
评论 #43934497 未加载
评论 #43935461 未加载
m3kw95 天前
These legos doesn&#x27;t look very intricate even by 200 pc box standards.
londons_explore5 天前
&gt; voxelizing it onto a grid and applying <i>legolization</i><p>I guess I learned a word today...
xeyownt5 天前
So, besides training a LLM to generate build instructions for lego model, they have robots to assemble these models, and they applied 3D texture on 3D generated model (what for?).<p>Sometimes the amount of money and energy that are spent in &quot;recreation&quot; projects just amazes me.
评论 #43934554 未加载
serial_dev4 天前
It would make sense for a car to have proper LEGO wheels.
benob5 天前
It looks like it is an extension of 3d model generation techniques.
nurettin5 天前
This could prove useful for minecraft bot scene
评论 #43935782 未加载