TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: Where can I find datasets of size greater than 1 GB?

13 pointsby alagappanrover 11 years ago
I am looking for datasets of size greater than 1 GB for a graduate academic project.<p>Datasets which are publicly available (or available upon request) and contain location-data and&#x2F;or vary over a period of time.

9 comments

benologistover 11 years ago
<a href="http://aws.amazon.com/datasets/" rel="nofollow">http:&#x2F;&#x2F;aws.amazon.com&#x2F;datasets&#x2F;</a>
tobias2014over 11 years ago
Try <a href="http://academictorrents.com/" rel="nofollow">http:&#x2F;&#x2F;academictorrents.com&#x2F;</a> See also the comments in <a href="https://news.ycombinator.com/item?id=7149006" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=7149006</a>
rellimevadover 11 years ago
Historical weather would fit your description. The NOAA has a large collection going back a century or more from different weather stations.<p>ftp:&#x2F;&#x2F;ftp.ncdc.noaa.gov&#x2F;pub&#x2F;data&#x2F;
maxericksonover 11 years ago
Openstreetmap?<p>Not sure that is the sort of data you want. In the U.S., lots of states and the federal government also have extensive geographical data sets (so you mind find one with a theme you are more interested in).
bloodorangeover 11 years ago
Look for the following:<p>Census data<p>Maybe wikipedia&#x27;s data is available?<p>Is there some open search engine, which gives its data free?<p>There could be more but I&#x27;m tired and this will hopefully be of help.
jakeoghabout 11 years ago
<a href="http://911datasets.org/images/911datasets.org_all_torrents_Jan_30_2014.zip" rel="nofollow">http:&#x2F;&#x2F;911datasets.org&#x2F;images&#x2F;911datasets.org_all_torrents_J...</a>
blamarvtabout 11 years ago
<a href="http://www.imdb.com/interfaces" rel="nofollow">http:&#x2F;&#x2F;www.imdb.com&#x2F;interfaces</a>
jennoover 11 years ago
You can download Wikipedia data; with only articles, it&#x27;s around 20gb.
AznHisokaabout 11 years ago
OpenCrawl has TBs worth of info.