TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

I put sheet music into smart glasses [video]

200 点作者 alex1115alex大约 1 个月前
<a href="https:&#x2F;&#x2F;github.com&#x2F;kevinlinxc&#x2F;AugmentedChords">https:&#x2F;&#x2F;github.com&#x2F;kevinlinxc&#x2F;AugmentedChords</a>

23 条评论

gavinray大约 1 个月前
I am so unbelievably excited for consumer-grade, useful AR.<p>There was a lot of hype around VR, but for the last 10 years I&#x27;ve been following progress on AR glasses.<p>The thing about AR is that it has the ability to enhance everything in your daily life, versus VR which is meant to be a separate experience.<p>Both Meta and Samsung are due to put out consumer AR glasses later this year and I think this might be the first wave of useful, daily-wear glasses we&#x27;ll see.<p>Is there anyone who works in the AR space that could comment more?
评论 #43879146 未加载
评论 #43879949 未加载
评论 #43880775 未加载
评论 #43878672 未加载
评论 #43877911 未加载
评论 #43880954 未加载
dang大约 1 个月前
This project is cool so we&#x27;re hoping to arrange with Kevin to do a Show HN about it, so stay, er, tuned!
评论 #43877483 未加载
评论 #43877607 未加载
alex1115alex大约 1 个月前
One of our users documented projecting sheet music onto his smart glasses&#x27;s display (with a HUD). He did a great job documenting the limitations of 2025&#x27;s tech, but it gives a great look into what&#x27;s going to be feasible next year.<p>Awesome job Kevin!
vunderba大约 1 个月前
Nice work. From the Github:<p><i>&gt; This allows the pianist to not have to turn pages, and more importantly, allows them to see the music and their hands at the same time, which is an unavoidable problem with traditional sheet music.</i><p>I could definitely see this being beneficial for beginners. When I lived in a dormitory during uni I often played familiar pieces from memory pretty late on a digital piano (with headphones) in extremely dim lighting so as not to disturb my roommate.<p>At some point I just stopped having to look down at the keyboard. I play a lot of stride piano as well and that probably conditioned me to just have a sort of musical proprioception for the instrument. And of course, there&#x27;s numerous examples of unbelievable blind pianists - Stevie Wonder, Ray Charles, Art Tatum, etc.
评论 #43877511 未加载
评论 #43878714 未加载
评论 #43877577 未加载
评论 #43878943 未加载
swyx大约 1 个月前
TIL about their glasses <a href="https:&#x2F;&#x2F;mentra.glass&#x2F;">https:&#x2F;&#x2F;mentra.glass&#x2F;</a><p>great video editing, OP. loved the playthru at the end with the text. you have real talent here, keep giong
评论 #43878910 未加载
hougaard大约 1 个月前
Fun, did that 8 years ago with the original Hololens <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=E6cBX4t2kX0" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=E6cBX4t2kX0</a>
simonjgreen大约 1 个月前
Super cool PoC. Also an advertisement for the value of local processing over cloud.
schobi大约 1 个月前
This is really awesome!<p>I was surprised about using dilation. I would have expected music21 to support rendering to a certain resolution&#x2F;dpi setting directly and avoid rescaling the images. But from the music21 documentation this is not obvious how to do it. Rendering music to a low dpi screen nicely (pixel perfect) could circumvent some of the hardware limitations in the mid term.
bambax大约 1 个月前
This is a really cool project.<p>From the end of the video:<p>&gt; <i>I had the bars of music auto-sending at a preset interval. The pedals, instead of flipping bars, temporarily pause the flipping or speed it up, in case I&#x27;m desynced from the glasses.</i><p>That&#x27;s how teleprompter apps work. Of course the difference is that when speaking you can pause a little if you get desynced, while with music you&#x27;re like &quot;on a train&quot; and if you pause, it shows. But having an interval is not shocking.<p>Maybe the problem with this is that typically, sheet music resolution is not constant -- if there are many short notes it will result in a larger space on the page (a larger bitmap) than if there are few long notes.<p>So maybe an approach is to send a fixed number of bars, regardless of their actual size, so that the interval can have a constant relation with the tempo of the piece?<p>&gt; <i>My dream smart glasses would just listen to the performance and automatically flip bars</i><p>Couldn&#x27;t the phone do that? The phone is already the part doing most of the work.
Abishek_Muthian大约 1 个月前
Congratulations for the project and for winning the hackathon, nicely done!<p>I am looking for hackable smart glasses with camera which doesn&#x27;t rely upon any proprietary service to work, Mentra seems to have a camera version but this video seems to suggest that we need to use their service all the time?
评论 #43879231 未加载
ginko大约 1 个月前
Really nice project.<p>Would be interesting to dive a bit deeper where this 3s latency comes from. I assume the bitmaps have been pregenerated so I guess it&#x27;s just the turnaround time when accessing the AugmentOS servers?
评论 #43879280 未加载
评论 #43878920 未加载
mk_stjames大约 1 个月前
All these glasses have so many layers of abstraction I don&#x27;t want between something I develop and the display.<p>Let me connect via bluetooth direct to the glasses with anything and just tx&#x2F;rx via a serial port and some low level protocol to get pixels&#x2F;text on the screen.<p>This is also the only way I&#x27;d be able to buy a pair and feel safe it won&#x27;t be able to be bricked in 2 years when some company shuts their server down and ends support.
评论 #43880806 未加载
评论 #43879080 未加载
评论 #43878459 未加载
joshuanapoli大约 1 个月前
That’s a fabulous project video!
rtrgrd大约 1 个月前
Cool project! I have a suggestion - since the processing is done on a moderately powerful laptop anyway, is it possible to bypass the foot pedal and use audio (from laptop or glasses) to predict when to switch to the next bar? I assume it will be a complicated but would trying to match the FFT series to the sheet music pitch data work (or would harmonics cause major headcahes?)
评论 #43877669 未加载
illwrks大约 1 个月前
This is great!!!<p>A lot of digital pianos have midi out, (there was a midi recording tool posted here months ago by another HN member) I wonder if you could use that midi signal to keep what you see in sync with your playing to drive page turns? You could even add a karaoke like highlight to show the note being played.
seabass大约 1 个月前
Really awesome project! I’m reminded of something else in the AR&#x2F;music space from a few years back. Someone made a VR passthrough app to project synthesia-style keyboard overlays onto your actual piano keys. Always cool to see what new hardware can enable. Congrats!
hhyndman大约 1 个月前
What a great idea. I am a musician and use an iPad for my scores. It would be wonderful to replace my glasses with a pair that can display the music.<p>I noticed the iron ring on your pinkie -- Canadian engineer?
评论 #43878894 未加载
pazimzadeh大约 1 个月前
Nice, I recently had a very similar idea. I bought the Vusix Z100 from Amazon japan to do this kind of thing. They also run AugmentOS (supposedly? iOS doesn&#x27;t seem supported yet) so I&#x27;ll try yours out.
cpursley大约 1 个月前
Okay, I think I&#x27;m finally sold that AR has useful applications. As non-gammer, I&#x27;ve sort of mostly written it off. Cool stuff.
bix6大约 1 个月前
Wow can’t wait for v2!
patrickhogan1大约 1 个月前
That’s super cool.
OkGoDoIt大约 1 个月前
Now that’s an awesome hackathon project! Exciting to see that smartglasses are finally getting to an interesting place.
Chipen大约 1 个月前
cool~