TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Pop2Piano: Pop audio-based piano cover generation

248 pointsby modinfoover 2 years ago

20 comments

vikbezover 2 years ago
Well I recently home-made a player piano [1] this will be perfect for it :D Thanks !<p>[1] : <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=atJ_YsPFDjQ">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=atJ_YsPFDjQ</a>
评论 #34210394 未加载
评论 #34210712 未加载
评论 #34210008 未加载
fumblebeeover 2 years ago
Unbelievably cool. Great job.<p>Tangentially — apologies if this is the wrong thread for this —, I know this is distinct to AI generated music (the melody here is a one-to-one mapping between the input song and output piano), but I’m curious when folks here think when the first totally generated artist will go mainstream with chart hits and millions of “followers”. With both an AI generated avatar and AI generated music. And no, not like Gorillaz who simply had fake cartoon personas.<p>If you believe the argument floating around that content we consume in the future will be hyper individualised to the point music&#x2F;tv will be generated just for us, then maybe never. IMO that runs counter to shared idolatry that people seem to crave, seems to me just a matter of time.
评论 #34207135 未加载
评论 #34209875 未加载
评论 #34208904 未加载
评论 #34207735 未加载
评论 #34210022 未加载
dehrmannover 2 years ago
Is there a way to make sure the output is playable? Playing this looks like a bit of a stretch: <a href="https:&#x2F;&#x2F;i.imgur.com&#x2F;pFC7tAr.png" rel="nofollow">https:&#x2F;&#x2F;i.imgur.com&#x2F;pFC7tAr.png</a>
pimlottcover 2 years ago
This is pretty neat, but are they actually playable by a single human pianist? There&#x27;s parts of the demo video where there are 10 simultaneous notes being played over 4 octaves, which doesn&#x27;t seem humanly possible. Identifying the notes and chords being played is a big step but you&#x27;ve also got to adapt to the limitations of the instrument and figure out how to simplify it to be playable while retaining the same essence. That&#x27;s a big part of what makes arrangement difficult.
评论 #34209012 未加载
评论 #34209848 未加载
sigmarover 2 years ago
Very cool. Note that it outputs midi and the demo chose to use a terrible piano sound, there&#x27;s better free samples they could have used. I threw in a flac of the weirdest (read: most nonsensical melody, nowhere close to pop) song I could think of (Mupp - vendetta) into the collab and it seemed to do pretty well capturing the melody. Composer 1 lost some of the nuance of the melody at 0:50, but composer 14 got much closer.
Rochusover 2 years ago
That&#x27;s amazing, congrats to the authors. Wonder how it would perform on harmonically more complex pop songs (e.g. <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=ZnRxTW8GxT8">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=ZnRxTW8GxT8</a>).
评论 #34206260 未加载
DoingSomeThingsover 2 years ago
1. Very cool tool. Awesome work!<p>2. How would one go about practicing irl to be able to play in the style of the piano covers?<p>This is the style of piano I would love to be able to perform. I can read lead sheets and know music theory, but I just don&#x27;t have the hand chops to perform. Every piano instruction book or tutorial I run across is based on developing progressive skills for classical performance. Pop style playing is distinct and I&#x27;ve never known how to progress my skills.
评论 #34207235 未加载
评论 #34210097 未加载
dehrmannover 2 years ago
Sk8er Boi is an impressive song to demo. The chorus is in a different key than the verse, and one of the verse chords is out-of-key, borrowed from the chorus.
abidlabsover 2 years ago
Pop2piano Gradio demo: <a href="https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;sweetcocoa&#x2F;pop2piano" rel="nofollow">https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;sweetcocoa&#x2F;pop2piano</a>
评论 #34216439 未加载
评论 #34213404 未加载
bumbyover 2 years ago
Is it possible to have the output in traditional sight-reading notation?
评论 #34207013 未加载
smrtinsertover 2 years ago
Does it generate human playable arrangements? I don&#x27;t even know what that means, but I assume there&#x27;s some max width fingers can travel or have pressed down at the same time. This is an awesome thing and I can&#x27;t wait to play with its output in my daws.<p>This is continued proof to me that the future is art on demand that is instantly created and shared and does not need to be captured in a static form like a youtube video.
agolioover 2 years ago
Cool - but there is no proof that these demo songs are out-of-sample, and the trained model does not seem to be available in the github.<p>If I am understanding correctly, the github code doesn&#x27;t contain the code to train the model? [1]<p>The paper also doesn&#x27;t seem to be peer-reviewed? (I guess it is pre-review, since it is on arxiv only 2m ago)<p>No disrespect to the authors - looks like a really cool project - I am just a bit suspicious without seeing any performance on user-submitted data.<p>[1] <a href="https:&#x2F;&#x2F;github.com&#x2F;sweetcocoa&#x2F;pop2piano&#x2F;issues&#x2F;3">https:&#x2F;&#x2F;github.com&#x2F;sweetcocoa&#x2F;pop2piano&#x2F;issues&#x2F;3</a>
评论 #34210668 未加载
评论 #34212302 未加载
评论 #34211064 未加载
Namidairoover 2 years ago
I wonder if this would yield even better results if it were to be split into multiple tracks in the pre-processing stage with something like Demucs.[1]<p><a href="https:&#x2F;&#x2F;github.com&#x2F;facebookresearch&#x2F;demucs">https:&#x2F;&#x2F;github.com&#x2F;facebookresearch&#x2F;demucs</a>
sampoover 2 years ago
The song by Younha in the video ( <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=-SuI6snsbc4#t=1m26s">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=-SuI6snsbc4#t=1m26s</a> ), doesn&#x27;t it look like you&#x27;d need more than 2 hands to play the piano arrangement?
ameliusover 2 years ago
Reminds me of:<p><a href="https:&#x2F;&#x2F;www.microsoft.com&#x2F;en-us&#x2F;research&#x2F;project&#x2F;songsmith-2&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.microsoft.com&#x2F;en-us&#x2F;research&#x2F;project&#x2F;songsmith-2...</a>
dehrmannover 2 years ago
I went to watch the video, saw &quot;Seoul National University,&quot; figured that makes sense with how big K-Pop is. Then &quot;Dynamite&quot; came on.
ThrowawayTestrover 2 years ago
The covers sound really good. I wanna try running it against similar genres of music, see if anything is transferable.
ameliusover 2 years ago
Would this work on e.g. heavy metal? Or would that be too far outside the network&#x27;s training set?
fassssstover 2 years ago
Oooo it outputs midi. Time to fire up Ableton and make use of Keyscape and all my VST’s. Thanks!
评论 #34210512 未加载
switchstanceover 2 years ago
قفل
评论 #34211136 未加载