TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: What's a good algorithm to distribute data in a P2P network

7 pointsby sippndippover 6 years ago
I'm on the search for a good algorithm (no implementation needed) that distributes data in a P2P network. The goal should be to maximize availability.

2 comments

ArtWombover 6 years ago
This is the classic &quot;Gnutella problem&quot; of scalability and is still I believe very much an open problem. One runs into it in WebRTC multicast scenarios. But fortunately there are many vendors such as Twilio that provide cloud solutions ;)<p>Best solution is to overlay a distributed hash table as k-v store over the p2p network. Nodes can then query that instead of each other. You can make your implementation more robust by exploiting and rewarding nodes in the network that have faster net connections, more compute power, etc. Best of luck!<p>OpenDHT: A C++11 Distributed Hash Table implementation<p><a href="https:&#x2F;&#x2F;github.com&#x2F;savoirfairelinux&#x2F;opendht" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;savoirfairelinux&#x2F;opendht</a>
sippndippover 6 years ago
I have found a paper about CRUSH maps so far (from the Ceph project): <a href="https:&#x2F;&#x2F;ceph.com&#x2F;wp-content&#x2F;uploads&#x2F;2016&#x2F;08&#x2F;weil-crush-sc06.pdf" rel="nofollow">https:&#x2F;&#x2F;ceph.com&#x2F;wp-content&#x2F;uploads&#x2F;2016&#x2F;08&#x2F;weil-crush-sc06....</a> but I think there is more.