JamRTC – WebRTC for Live Musicians

I built a similar project for in-browser jamming with midi-keyboards<p><a href="https:&#x2F;&#x2F;github.com&#x2F;jminjie&#x2F;fourhands" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;jminjie&#x2F;fourhands</a><p>The benefit of this is that it takes no set-up for non tech users. The major downsides are that it&#x27;s only 2 player, and only works for midi instruments.<p>On Fourhands you can actually achieve very low latency (&lt;20ms) with WebRTC for somewhat close players on wired connections. If you&#x27;re having latency trouble like your readme says, I&#x27;m guessing it&#x27;s not the WebRTC part.

We previously talked about JackTrip WebRTC[1], which I first thought was similar. But while JamRTC uses WebRTC, it&#x27;s not actually browser based, while JackTrip WebRTC is. (And of course they <i>are</i> similar in that they are tring to do low-latency audio conferencing via WebRTC.)<p>And then there is regular JackTrip, which the author refers to in the FAQ, which is neither browser- nor WebRTC-based.<p>[1] <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=25942829" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=25942829</a>

I worked on a project similar when the pandemic started last year. Ran into latency problem and just couldn&#x27;t find a way around it. Add to the latency issue is also the global metronome as well.

Wow neat! I’ve been working on something similar, just optimized for keyboards only with midi data, intended for use as a complement of having a remote teacher on the line while using it.<p>The project is called Midishare <a href="https:&#x2F;&#x2F;github.com&#x2F;corytheboyd&#x2F;midishare" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;corytheboyd&#x2F;midishare</a>. The site is live but I am very much working on core functionality still. If you do want to try it just reach out, or hop on the discussion forum linked in the nav!

Awesome stuff. If you use it, do yourself a latency favor and avoid WiFi connections. Use ethernet.<p>Some SDP munging in the clients can shorten Opus packets, which helps. If they&#x27;re longer than 20ms things get ugly.<p>I tried using a swarm approach (full mesh of point-to-point WebRTC connections) for plain audio, no video. I got the latency down to about 70 ms transcontinental, but my musician alpha tester (brother) didn&#x27;t go for it.<p>Let&#x27;s get this to work!

I would like to see latency benchmark comparisons for each of these tools.

Some other interesting projects<p>ninjam&#x2F;jamtaba - instead of minimizing latency, accept it and delay everyone in a synchronized way<p>endlesss - multiple people adding layers to an 8ch looper

I plated with WebMIDI a few years ago. Thought it would be fun to build a player piano broadcast service, where anyone with a MIDI device could play a piano remotely. Never built it though.<p><a href="https:&#x2F;&#x2F;github.com&#x2F;appsforartists&#x2F;midicast" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;appsforartists&#x2F;midicast</a>

I love these kinds of projects.<p>We are layering AI on top of all kinds of problems. It feels like the sync problem when latency is introduced is something that you could solve with some dumb AI.<p>Is AI solving sync part of the third wave for musicians composing over the internet in real time?

There&#x27;s also Sonobus, an open source peer-2-peer streaming app with a nice intuitive GUI and rich feature set: <a href="https:&#x2F;&#x2F;sonobus.net&#x2F;" rel="nofollow">https:&#x2F;&#x2F;sonobus.net&#x2F;</a><p>It is also available as a VST plugin!

Isn’t there a physical limit on delay that prohibits live, non-co-located music making?

jamkazam (<a href="https:&#x2F;&#x2F;jamkazam.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;jamkazam.com&#x2F;</a>) is commercial product that does this. They also make custom hardware optimized for latency and streaming. I used it a few years ago (before the custom hardware was available) and getting all the members&#x27; hardware configured was a bit of a pain, but the potential was there.

I&#x27;m zero on this tech, but I&#x27;d like to see this type of project work.

back in 1990 this is what I wanted to build. but all I knew was html back then. good to see someone finally did it!