TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Using BitTorrent with Amazon S3

189 pointsby folzabout 10 years ago

16 comments

RKearneyabout 10 years ago
I&#x27;m fairly certain this has been a feature of S3 since its launch in 2006. Here&#x27;s as far back as I could find on archive.org[0] it&#x27;s May 24th 2006 and the URL indicates the documentation was published on March 2006.<p>[0] <a href="http:&#x2F;&#x2F;web.archive.org&#x2F;web&#x2F;20060421112025&#x2F;http:&#x2F;&#x2F;docs.amazonwebservices.com&#x2F;AmazonS3&#x2F;2006-03-01&#x2F;" rel="nofollow">http:&#x2F;&#x2F;web.archive.org&#x2F;web&#x2F;20060421112025&#x2F;http:&#x2F;&#x2F;docs.amazon...</a>
评论 #9565402 未加载
__Jokerabout 10 years ago
Anyone downloading software or any content over a slow and flaky network would question why people don&#x27;t use torrents for distribution with some &quot;permanent&quot; seeder.<p>I really had a horrible experience sometime back, while downloading a software of around 2 GB. Where a network would die down and chrome would discard the partial download.
评论 #9563306 未加载
评论 #9564104 未加载
评论 #9563312 未加载
评论 #9563613 未加载
评论 #9563704 未加载
评论 #9563314 未加载
评论 #9563789 未加载
imrehgabout 10 years ago
Just moved a bunch of our company&#x27;s large downloads over to S3 recently (mostly BSP releases and drivers), and this would be awesome for that 100MB - 4GB package size range that they have!<p>Tried it with a few clients: Transmission does not seem to work, though (both web client, and GTK): &quot;Tracker gave HTTP response code 404...&quot;; rtorrent seems to be able to download (but looks like no upload?); deluge downloads well and also kickstarts the transmission clients.<p>I wonder what&#x27;s unacceptable in the Amazon infrastructure for transmission... And the 80kb&#x2F;s max seed rate mentioned in the comments might be a showstopper already.
评论 #9565712 未加载
jberkelabout 10 years ago
I&#x27;m currently using this to build a decentralized distribution system to ship relatively big database files to iOS clients without having to go through S3 all the time. It works quite well but some providers throttle the bittorrent traffic (or worse, throw in RST packets) so I&#x27;m not sure how well this will work in practice. Also note that the S3 default seeders only upload at around 80kb&#x2F;s, so you&#x27;ll always need at least one external seed to get good performance.
评论 #9563520 未加载
评论 #9563491 未加载
byaruhafabout 10 years ago
You can get torrent only for objects that are less than 5 GB in size. That&#x27;s a bit limited.
评论 #9563230 未加载
评论 #9563229 未加载
评论 #9563192 未加载
评论 #9563261 未加载
评论 #9563195 未加载
userbinatorabout 10 years ago
A bit OT but...<p><i>Javascript is disabled or is unavailable in your browser. To use the AWS Documentation, Javascript must be enabled.</i><p>...really? Their documentation is perfectly readable without it. All the links are real, bookmarkable links; even the buttons for the PDF, forums, and Kindle version work.
评论 #9563495 未加载
zurnabout 10 years ago
Are there easy to use multiplartform BT libs around that would let you use this just for high bandwidth, nearby peers? Eg filter peers by latency as a first pass.
评论 #9563407 未加载
评论 #9563244 未加载
gwernabout 10 years ago
I&#x27;ve used this in the past to distribute scrapes of black-markets (eg <a href="https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;DarkNetMarkets&#x2F;comments&#x2F;2zps7q&#x2F;evolution_forums_mirrorscrapes_torrent_released&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;DarkNetMarkets&#x2F;comments&#x2F;2zps7q&#x2F;evol...</a> &amp; <a href="https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;DarkNetMarkets&#x2F;comments&#x2F;2zllmv&#x2F;evolution_market_mirrorscrapes_torrent_released&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;DarkNetMarkets&#x2F;comments&#x2F;2zllmv&#x2F;evol...</a> ). It saves a lot of bandwidth (which is not all <i>that</i> cheap on S3) and so far the &lt;5gb restriction hasn&#x27;t been an issue.
ShirsenduKabout 10 years ago
Wow! This may lower the entry barrier for a new movie&#x2F;TV streaming company. They can lower their costs by offsetting the bandwidth to users. Legal torrent streaming might have just got the boost it requires.
评论 #9563397 未加载
评论 #9563413 未加载
评论 #9563662 未加载
NKCSSabout 10 years ago
Could be cool to get better speeds, if they have multiple seeders for the bucket.
评论 #9563205 未加载
diminoabout 10 years ago
I once read an article or email about why web browsers can&#x27;t&#x2F;won&#x27;t implement BitTorrent clients -- one of the biggest barriers IMO to making BitTorrent more ubiquitous for file download&#x2F;upload is the fact that I can&#x27;t just click on a link and have my browser handle the rest, like I can with an HTTP&#x2F;FTP link.<p>Does anyone have a link that explains why browsers won&#x27;t do this, or at least a brief explanation?
评论 #9565778 未加载
rctay89about 10 years ago
Apart from myself, anyone else hoping to see <i>downloading</i> straight into an S3 bucket? (Seeding from a bucket has been around for some time, you could imagine my disappointment when clicking the link)
Sami_Lehtinenabout 10 years ago
It still needs BitTorrent client. How about doing exactly the same but using WebRTC which would work without additional client application.
tedchsabout 10 years ago
Uh, this feature has been available for years, hardly &quot;news&quot;.
fiatjafabout 10 years ago
I&#x27;m dreaming about using IPFS on S3. Will it be possible?
cosqlabout 10 years ago
awesome