Google and Bing aren't doing right by me. All I'm finding are crappy SEO optimized sites. As you might surmise, there's a lot of web scraping and natural language processing in my near future, but I need a corpus of decent RSS feeds to start scraping.<p>What I'm looking for is a way to collect several thousand decent economic and financial news RSS feeds for my startup, Newsley.com.<p>Aside from gathering these by hand, has anyone found a great directory of RSS feeds? (If you have a list of a whole lot of economic and financial feeds in your Google Reader account, export the list, email it to me. I'll buy you beer or your beverage of choice. )<p>Alternatively, I'd love to hear a brainstorm or suggestions on where to find collections of RSS feeds. or ways in which a bunch of RSS feeds could be gathered.<p>Suggestions?
Spider feedburner ?<p>wget -r google news and see what their sources are ?<p><a href="http://www.feedage.com/categories/News/1/4" rel="nofollow">http://www.feedage.com/categories/News/1/4</a>
Have you considered using the PostRank Topic API?<p><a href="http://www.postrank.com/developers/api#topic" rel="nofollow">http://www.postrank.com/developers/api#topic</a>
Bloglines has a pretty decent feed search.<p><a href="http://www.bloglines.com/search?q=finance&t=f&ql=en&s=f&pop=l&news=m" rel="nofollow">http://www.bloglines.com/search?q=finance&t=f&ql=en&...</a><p>plus a top 1000 feeds:<p><a href="http://beta.bloglines.com/topfeeds" rel="nofollow">http://beta.bloglines.com/topfeeds</a>
<a href="http://seekingalpha.com/" rel="nofollow">http://seekingalpha.com/</a> syndicates a whole bunch of financial blogs. They don't have feeds for individual contributors and I'm not sure of the quality of their topics feeds, but if you crawl carefully you may be able to find your way to the original blogs of many of their contributors.
Marshall Kirkpatrick asked his internet friends for OPML files for his birthday:<p><a href="http://marshallk.com/its-my-birthday-you-should-make-me-a-present" rel="nofollow">http://marshallk.com/its-my-birthday-you-should-make-me-a-pr...</a><p>It could work for you too...
Check delicious? I myself sometimes tag blogs I find that only _might_ be useful later, rather than subscribe to them. At first pass I pulled a bunch, with a pretty low false positive rate at least on the first few, using economics+finance+blogs as tag filters.