My Favorite Public Data Sources

Advertisment submarine for Power BI. Shallow on content, mostly a pretty random list.

Here&#x27;s a long list of (awesome) public datasets:<p><a href="https:&#x2F;&#x2F;github.com&#x2F;caesar0301&#x2F;awesome-public-datasets" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;caesar0301&#x2F;awesome-public-datasets</a>

I was looking for these types of sources this week to populate a document database. One I ended up using for a demonstration was the &quot;startup company information&quot; hosted at <a href="http:&#x2F;&#x2F;jsonstudio.com&#x2F;resources&#x2F;" rel="nofollow">http:&#x2F;&#x2F;jsonstudio.com&#x2F;resources&#x2F;</a> (apparently an extract from CrunchBase, mentioned in Jen&#x27;s blog post).<p>I naively thought I could just grab a pile of tweets or something, but most public APIs require registration as a developer.<p>One quick tip, if you&#x27;re dealing with JSON dumps as a series of objects (e.g., {} {} {}) that you want to wrap in an array (e.g., [{}, {}, {}]), is to &quot;slurp&quot; them into jq (<a href="https:&#x2F;&#x2F;stedolan.github.io&#x2F;jq&#x2F;" rel="nofollow">https:&#x2F;&#x2F;stedolan.github.io&#x2F;jq&#x2F;</a>):<p><pre><code> $ jq -s &#x27;.&#x27; companies.json &gt; companies-array.json</code></pre>

I just started looking at her top listed data source, the GDELT Project[1]. Kind of mind blowing.<p>[1] <a href="http:&#x2F;&#x2F;www.gdeltproject.org&#x2F;" rel="nofollow">http:&#x2F;&#x2F;www.gdeltproject.org&#x2F;</a>