I developed a small tool to find RSS feeds for websites. You can try it out here: <a href="https://lighthouseapp.io/tools/feed-finder" rel="nofollow">https://lighthouseapp.io/tools/feed-finder</a><p>In >90% of cases the standard way of checking meta tags is enough to find the feeds. But my goal for this tool is that it finds feeds regardless if they're linked somewhere or not. That if this feed finder doesn't find a feed, no feed exists.<p>It's a big goal and admittedly not there yet, but it does a few things that are a step in that direction.<p>* Checks meta tags of parent pages (sometimes the article itself doesn't have the meta tag, but the main blog page does)<p>* Checks common suffixes like /rss, /index.xml and many others (sometimes the feed exists but isn't linked)<p>* Checks the sitemap<p>* Checks all links on the page<p>* Checks 3rd party feeds (OpenRSS for now, when I find more such repositories I'll add them too)<p>There are a couple of additional ideas I have, like checking search engines and crawling the entire domain (highly inefficient, but possible).<p>Would love if you could try it, and even more if you post sites where it doesn't work.
Quick rant about websites that go into all the trouble of <i>having</i> an RSS feed but not linking to it in the <head>... I don't want to go hunting for the cute orange button, I want to copy and paste "<a href="https://example.com" rel="nofollow">https://example.com</a>" into my feed reader and let the computer handle the work.<p>If you maintain any website with a news feed, go right now and check that you have this in your <head>:<p><pre><code> <link rel="alternate" type="application/rss+xml" href="/rss.xml" title="News feed" />
^^^^^^^^ change! ^^^^^^^^^
</code></pre>
(Also note whether and where you need to use application/rss+xml, application/atom+xml, or application/json.)
This is great, it's hard to believe sites can have RSS feeds but make it so difficult to find.<p>I suspect some sites are just running some framework than enables it and don't even realize they have one.<p>I have used this site in the past to find feeds:
<a href="https://www.rsssearchhub.com/" rel="nofollow">https://www.rsssearchhub.com/</a><p>In the past I was looking for a feed for <a href="https://ra.co" rel="nofollow">https://ra.co</a>, but could not find it, though I had seen old posts referencing a RSS feed.<p>I ended up emailing them and, to my delight, they let me know they still have an unsupported RSS feed here:<p><a href="https://ra.co/xml/rss_news.xml" rel="nofollow">https://ra.co/xml/rss_news.xml</a><p>Just for feedback, this tool doesn't find the feed, though it doesn't look like a standard URL to me.
If I can't find an RSS link directly, I generally copy the root URL into archive.org and search for all URLs matching "xml", which includes content type, not just URL names.
This is 100% a feature that should be in the browser, not a third party tool. I still use an very old version of Firefox for this. Too bad Mozilla decided auto-discovery wasn't necessary in 2016 and removed it. Then two years later claimed no one was aware of RSS/Atom feeds and didn't use them (I wonder why?!?). All so they could try to replace it with their profit/adware that is pocket and we all know how that went.<p>>Mozilla is working on alternatives such as Pocket or Reader Mode, and on improving WebExtensions which could provide features related to RSS/Atom feeds without the toll on maintenance. (ref: <a href="https://www.ghacks.net/2018/07/25/mozilla-plans-to-remove-rss-feed-reader-and-live-bookmarks-support-from-firefox/" rel="nofollow">https://www.ghacks.net/2018/07/25/mozilla-plans-to-remove-rs...</a>)
Interesting. These days I was trying to subscribe to some blogs, and they didn’t have a RSS button in their page, so I had to inspect the page to find out the feed URL. Not sure why keep a RSS feed but hide from the visitors. It could be it expected the feed reader to be able to identify it, but since I was using Thunderbird it did not.
> Application error: a client-side exception has occurred (see the browser console for more information).<p>Ok then.<p>Also, this would make more sense as a browser extension. Especially if it brought back the RSS icon in the address bar to indicate when a feed is available (although maybe you don't want it to do all of the checks until prompted).
Great idea. I tried it with my personal site (<a href="https://matthew.science" rel="nofollow">https://matthew.science</a>) and it didn't find any, which admittedly doesn't have any meta tags, but it is linked at the footer at <a href="https://matthew.science/atom.xml" rel="nofollow">https://matthew.science/atom.xml</a>. It was the default feed URL for my SSG. I'd recommend adding this to the common suffix list.
Tried the hacker news front page (<a href="https://news.ycombinator.com/news">https://news.ycombinator.com/news</a>) and when clicking on OpenRSS I get this error:<p>TypeError: URL constructor: is not a valid URL. [NextJS] (5603-cb6f1c5a9761f9d0.js:14:5466)<p>Browser is Firefox 130.0 on Windows.<p>Would be really nice to see this working really well since I search for RSS feeds a lot for a bunch of different things. Whether the RSS feed is good is always another question.
FYI it's only finding one (Atom) feed at earth.org.uk, even though there are several feeds, Atom and RSS.<p>Your method described above should have found at least two feeds I think.
I've been using an NPM package called rss-url-finder [1] in my blog search engine project to find the RSS link. It works relatively well, but still fails sometimes. For now I end up manually searching the source code of the HTML page for .xml or similar link.<p>[1] <a href="https://www.npmjs.com/package/rss-url-finder" rel="nofollow">https://www.npmjs.com/package/rss-url-finder</a>
Are you opposed to this being used programmatically? I've been working on a site [0] that replays feeds, but the initial step is to first find the feed given a website, and it's not always able to find it. I'd be interested in using your service to try to find the feed when I'm unable to do so.<p>[0] <a href="https://refeed.to" rel="nofollow">https://refeed.to</a>
Great work! I've stopped using Twitter but I managed to taper from it by following things using RSS feeds drawn from Nitter. Don't know if that still works but could be an idea?
add also .feed to common suffixes
example: <a href="https://wiadomosci.onet.pl/.feed" rel="nofollow">https://wiadomosci.onet.pl/.feed</a>
Great tools.<p>I always use RSSHub Radar , Your tools support more website than RSSHub Radar<p>Detection of /feed could be added, most wordpres supported sites have this suffix