TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Making S3 More Resilient Using Lambda Edge

64 pointsby thelonelygodover 5 years ago

8 comments

sciurusover 5 years ago
Before they&#x27;d be affected by Route 53 outages, Cloudfront outages, and S3 outages. Now they can add Lambda outages to that list too.<p>It&#x27;s also unclear how this actually solves the problem. Now if S3 in _either_ region is unavailable they&#x27;ll start to fail 50% of uncached requests. I&#x27;m guessing they&#x27;re using Route 53 health checks with some cloudwatch alarm to cut over to one region when they think the other is unhealthy. Presumably this is covered in the unavailable part 2.<p>I&#x27;m mildly skeptical that this is worth the increased risks plus the increased cost from running Lambda@Edge on cache misses.
评论 #21808149 未加载
评论 #21809049 未加载
评论 #21808229 未加载
ReidZBover 5 years ago
If the &quot;Cross-region replication&quot; line in the picture is talking about the native S3 cross-region replication (as I assume it is), beware the replication latency in this setup. AWS recently released &quot;replication with an SLA&quot; for S3 [0], but at &quot;99.99% of the objects will be replicated within 15 minutes&quot;, it&#x27;s not a good enough SLA to rely on in setups like this.<p>Presumably Part 2 of this post will address this limitation, or maybe their product isn&#x27;t affected by it. (I&#x27;ve never looked into Contentful, though maybe I will now -- blog post purpose achieved?)<p>I&#x27;m also not sure if &quot;active-active&quot; is the best name for this setup, since objects can&#x27;t be written to the 2nd bucket (replication only goes one direction). Generally I associate &quot;active-active&quot; with &quot;writes can happen anywhere&quot;, though maybe I&#x27;m wrong?<p>[0] <a href="https:&#x2F;&#x2F;aws.amazon.com&#x2F;blogs&#x2F;aws&#x2F;s3-replication-update-replication-sla-metrics-and-events&#x2F;" rel="nofollow">https:&#x2F;&#x2F;aws.amazon.com&#x2F;blogs&#x2F;aws&#x2F;s3-replication-update-repli...</a>
rynopover 5 years ago
Confused - why not use CloudFront Origin Groups? <a href="https:&#x2F;&#x2F;docs.aws.amazon.com&#x2F;AmazonCloudFront&#x2F;latest&#x2F;DeveloperGuide&#x2F;high_availability_origin_failover.html" rel="nofollow">https:&#x2F;&#x2F;docs.aws.amazon.com&#x2F;AmazonCloudFront&#x2F;latest&#x2F;Develope...</a><p>Full disclosure, I&#x27;ve never used, but pretty sure this feature was created for the scenario you are trying to solve.
评论 #21808078 未加载
Zaheerover 5 years ago
Although it may make sense to this company in _majority_ of companies this would be over-engineering. S3 availability is some of the best in the business. If S3 is down, a good chunk of the internet is down with it.
评论 #21811344 未加载
advisedwangover 5 years ago
Google Cloud Storage has multi-region storage classes. Does S3 not have an equivalent of this?
评论 #21809199 未加载
knodiover 5 years ago
Sorry I can&#x27;t condone the use of AWS lambda@edge. No central logs aggregation in an event of an issue or alerting.
评论 #21811876 未加载
zackbloomover 5 years ago
It&#x27;s worth pointing out you can just point Cloudflare Load Balancing at two S3 buckets and call it a day.
评论 #21811860 未加载
jugg1esover 5 years ago
The architecture described here is pretty simple. The article states the fix was 20 lines of code. If this is the hardest problem you have to solve at work, I envy you.