TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Earth on AWS – Open geospatial data

663 pointsby thecodeboyover 7 years ago

23 comments

rburhumover 7 years ago
Looking at the comments, most people don&#x27;t understand what this is.<p>In the geospatial industry, there are many organizations that produce free open data.<p>For example the NAIP image data comes USDA and has been paid for by the US govt so the city&#x2F;state can used it for agriculture - hence why the images are not just RGB, but they also include an infrared band so they can be used for agriculture algorithms like NDVI results. For that particular dataset the license is very liberal. In case you are curious about that particular problem, you can find more info here: <a href="https:&#x2F;&#x2F;www.fsa.usda.gov&#x2F;programs-and-services&#x2F;aerial-photography&#x2F;imagery-programs&#x2F;naip-imagery&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.fsa.usda.gov&#x2F;programs-and-services&#x2F;aerial-photog...</a><p>The problem with dealing with datasets of this size is that just the mere collection and storage of it, is a problem of resources. This AWS link here is saying that they have grabbed all these datasets from various govt and non-profits and are hosting them in raw form so you can use them. Because the data comes from so many different institutions, the license is different - but practically speaking super liberal.<p>It is not competing with any previous commercial service from any vendor, nor it is meant to be a solution of any kind... Just big public spatial datasets hosted at AWS.
评论 #15636246 未加载
评论 #15633879 未加载
评论 #15632105 未加载
colordropsover 7 years ago
Looks like a lot of this data comes from free sources. It&#x27;s not clear from their site what the licensing is though.
tantalorover 7 years ago
How does this compare to other offerings like Google Earth Engine[1], GCP Landsat[2], or GCP Sentinel-2[3]?<p>[1] <a href="https:&#x2F;&#x2F;earthengine.google.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;earthengine.google.com&#x2F;</a><p>[2] <a href="https:&#x2F;&#x2F;cloud.google.com&#x2F;storage&#x2F;docs&#x2F;public-datasets&#x2F;landsat" rel="nofollow">https:&#x2F;&#x2F;cloud.google.com&#x2F;storage&#x2F;docs&#x2F;public-datasets&#x2F;landsa...</a><p>[3] <a href="https:&#x2F;&#x2F;cloud.google.com&#x2F;storage&#x2F;docs&#x2F;public-datasets&#x2F;sentinel-2" rel="nofollow">https:&#x2F;&#x2F;cloud.google.com&#x2F;storage&#x2F;docs&#x2F;public-datasets&#x2F;sentin...</a>
cloverichover 7 years ago
In case you don&#x27;t scroll all the way down, there&#x27;s a list of articles and video&#x27;s titled &quot;Use cases&quot; at the bottom of the page which appear to cover (at least) how some of this data has been used.
评论 #15632139 未加载
gravypodover 7 years ago
&gt; and identifies the people, locations, organizations, counts, themes, sources, emotions, counts, quotes, images and events driving our global society every second of every day.<p>They&#x27;re really serious about counting, aren&#x27;t they.
评论 #15629876 未加载
Moocat87over 7 years ago
I&#x27;d like to see the National Snow and Ice Data Center&#x27;s data (soil moisture, sea ice cover&#x2F;concentration, snow cover [looks like MODIS is already available], permafrost, glacier outlines) on AWS.<p>I know there are people there that want to see it happen, but it&#x27;s a matter of cost. What incentives&#x2F;programs does Earth on AWS offer to assist stewards of public data to make it available on AWS?<p>Additionally, I think some of this data is normally behind URS&#x2F;Earthdata Login, what did the politics of making the data available on AWS without URS look like?
评论 #15632055 未加载
评论 #15631405 未加载
mentosover 7 years ago
Would love to see Amazon make an integration for Unreal Engine 4 or their Lumberyard video game engine so a game developer can easily import detailed swaths of the earth.
评论 #15629843 未加载
rmocnikover 7 years ago
Exploring thru these datasets can be quite addictable. Especially with service like <a href="http:&#x2F;&#x2F;apps.sentinel-hub.com&#x2F;sentinel-playground&#x2F;" rel="nofollow">http:&#x2F;&#x2F;apps.sentinel-hub.com&#x2F;sentinel-playground&#x2F;</a>
queriousover 7 years ago
What I&#x27;m psyched about is OpenStreetMaps data queryable with Athena. It&#x27;s traditionally kind of a pain to convert PBFs to a queryable format.
评论 #15632365 未加载
评论 #15633121 未加载
评论 #15631243 未加载
malux85over 7 years ago
Wow what great timing! Just as we are scaling up our imagery DL projects, this is cool!
lukejduncanover 7 years ago
I wonder how this compares to Planet Labs dataset.
评论 #15630237 未加载
评论 #15630439 未加载
brightballover 7 years ago
Wow...that’s a treasure trove of useful data all in one place. Major thanks to Amazon.
评论 #15629597 未加载
zitterbewegungover 7 years ago
This makes me want to take this open source weather forecasting model and run it on AWS. <a href="http:&#x2F;&#x2F;planetwrf.com" rel="nofollow">http:&#x2F;&#x2F;planetwrf.com</a>
评论 #15631425 未加载
评论 #15660607 未加载
phy07over 7 years ago
On a somewhat related topic - can anyone recommend a geocoder available through AWS?<p>There are several AWS marketplace solutions available on the link at the bottom of the original article.[1] Only Geolytica and Forward Geocoder seem to be available to new customers, and both have &lt; 5 reviews.<p>[1] <a href="https:&#x2F;&#x2F;aws.amazon.com&#x2F;mp&#x2F;gis&#x2F;#geocoding" rel="nofollow">https:&#x2F;&#x2F;aws.amazon.com&#x2F;mp&#x2F;gis&#x2F;#geocoding</a>
评论 #15629558 未加载
评论 #15630053 未加载
评论 #15629605 未加载
jaipilot747over 7 years ago
Slightly tangential, but is there a &quot;modern&quot; alternative to GDAL for working with raster data?<p>The last time I tried, stitching together tiles and cutting it to state boundaries took an inordinate amount of time (upwards of 15 minutes for 6 tiles from Landsat-7&#x2F;8). Though, I&#x27;m half convinced it was because I was doing something very suboptimal..<p>Also, iirc, it was single threaded.
评论 #15636566 未加载
borplkover 7 years ago
What are some interesting things to do with this?
评论 #15630193 未加载
评论 #15629812 未加载
评论 #15630896 未加载
pknerdover 7 years ago
Pardon if the question sounds dumb; will we have real time data of a certain region, for instance getting info about clouds?
评论 #15629754 未加载
评论 #15629769 未加载
wenbertover 7 years ago
I&#x27;m always interested in these kinds of data.<p>A few months ago, I was looking at different open sources to geocode a lot of addresses around the world.<p>I have tried openstreetmap and some VM from datasciencetoolkit - both have poor results.<p>Are there other sources aside from Google? Google appears to be the most accurate.
评论 #15632108 未加载
dsnuhover 7 years ago
Will the datasets be open to contribution from members of the public or are these readonly mirrors? Seems like Blue Horizon and Prime Now amongst many other of their offerings that would be use cases for up to the minute data?
评论 #15632794 未加载
kipropingover 7 years ago
I am waiting for the day we can get satellite images that are so fine you can see people or animals.
评论 #15635785 未加载
kttaover 7 years ago
This feels like another service Google can replicate and be much better at it considering their past experience.
评论 #15630746 未加载
评论 #15631015 未加载
评论 #15630670 未加载
_pdp_over 7 years ago
I know this will be cool if combined with machine learning but to do what? :)
评论 #15636351 未加载
评论 #15631284 未加载
cerealbadover 7 years ago
how can you keep everyone safe if you can&#x27;t see where they are, what they are doing or what is inside their head?