TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

How 500px serves up 500TB of high res photos

87 pointsby ranrubabout 10 years ago

6 comments

callumjonesabout 10 years ago
Interesting that they upload to S3 first, only to pull it off soon after and process it.<p>I imagine this reduces complexity and lets them increase their throughput of uploads but I wonder if 500px toyed around with the idea of first uploading it to local (temp) storage, having the workers process it and then finally persist it. But I guess the cons are a) some point it needs to go to S3 in original form b) increases data loss
评论 #9554572 未加载
评论 #9554168 未加载
评论 #9554141 未加载
评论 #9554553 未加载
dataminerabout 10 years ago
Thumbs up for VIPS, used it 4-5 years ago, for building a system which processed high resolution images. Its fast, lean and an amazing piece of software.
评论 #9588691 未加载
评论 #9570870 未加载
评论 #9554577 未加载
评论 #9554054 未加载
quasseabout 10 years ago
Are they somehow intercepting middle click on their site so that links do not open in a new tab? Control-click works fine for me, but middle click would just replace the article, which was inconvenient. (latest Chrome on Ubuntu)
评论 #9553888 未加载
评论 #9553854 未加载
评论 #9554975 未加载
评论 #9554268 未加载
happytrailsabout 10 years ago
All the services! An Engineer&#x27;s paradise.
cconceptsabout 10 years ago
I was getting excited about using 500px for the specific reason that it seems to load much faster than flickr. Then I loaded it up in a public space to get some inspiration by browsing other user&#x27;s work - interspersed were various images of women in various states of undress. I quickly exited the site and never went back for fear of someone glancing over my shoulder and assuming I&#x27;m doing something other than getting artistic inspiration.<p>Not arguing that the images aren&#x27;t art but I personally don&#x27;t want them popping up on my screen when I&#x27;m just trying to get inspiration for landscape photography.
评论 #9555273 未加载
ranrubabout 10 years ago
Popular photo sharing company opens the kimono on their photo processing stack.