TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Show HN: Sleeping Spider – Web page change monitor

31 点作者 linklet超过 10 年前

16 条评论

TheDong超过 10 年前
Does this site respect robots.txt?<p>Does it render javascript content (so e.g. &lt;div ng-view&gt; angular sites work)?<p>Does it exclude or include comments... if I watch a blogpost with comments will every new comment cause an alert or only blogpost changes?<p>Will I get a notification if the page briefly 500 errors when you hit it, or does it have to get a 200 before it reports a change?<p>Will I get a notification if a page disappears entirely?<p>Does it scrape only once per day or more often and alert only once a day?<p>What user-agent does it scrape from on the off-chance someone wants to block it?<p>Does it diff binary data.. for example, if I ask it to watch an image url will it hash the image and notify me when it gets updated?<p>Does it auto-detect pages with rss feeds or pubsub feeds and subscribe to them?<p>Does it understand twitter so if I watch a user, it only alerts me of tweets, not e.g. a change in the number of followers?<p>Does it have special code for any website whatsoever?<p>Is the webpage parsing&#x2F;diffing library &#x2F; algorithm open source somewhere?<p>Is there a monitization plan, and if not how can I trust it won&#x27;t vanish?<p>Is there a limit on the number of sites I can watch?<p>I like the simplistic design, but it would be nice if there were more information.
评论 #8513656 未加载
评论 #8510969 未加载
aw3c2超过 10 年前
If you prefer privacy and control over your own tools, there are the FLOSS <a href="http://specto.sourceforge.net/" rel="nofollow">http:&#x2F;&#x2F;specto.sourceforge.net&#x2F;</a> or the free(as in no cost)ware <a href="http://www.cmcode.co.uk/webmon/" rel="nofollow">http:&#x2F;&#x2F;www.cmcode.co.uk&#x2F;webmon&#x2F;</a> for Windows
评论 #8524700 未加载
评论 #8511632 未加载
netman21超过 10 年前
In the most amazing coincidence the first two pages I submitted had the same digest: 90c0568! One was the front page of a news site, the other was the management page of a company I follow. The mind boggles. Or, they have a bug.<p>edit: as did the 3rd. And 0 bytes returned so probably being blocked. On a black list already?
评论 #8511124 未加载
lucasjans超过 10 年前
Adding watch results in a white screen of nothing, no new watches added. I&#x27;m trying to monitor the Nexus 6 page :D<p><a href="https://play.google.com/store/devices/details/Nexus_6_32GB_Cloud_White?id=nexus_6_white_32gb" rel="nofollow">https:&#x2F;&#x2F;play.google.com&#x2F;store&#x2F;devices&#x2F;details&#x2F;Nexus_6_32GB_C...</a><p>For my use case, anything more than an hour delay wouldn&#x27;t be practical. Ideally it would be up to the minute, but I&#x27;d imagine that would cause other issues for a service like this. In the past I just used a Chrome Extension. But living in Vietnam I have to make sure my VPN is up in order to see the North American content.
评论 #8511089 未加载
sleepingspider超过 10 年前
&gt; Does it understand twitter so if I watch a user, it only alerts me of tweets, not e.g. a change in the number of followers?<p>What do you think if I provide a numeric filter option to watches, which filters out numbers on the page before comparing if turned on.
sleepingspider超过 10 年前
&gt; Does it exclude or include comments... if I watch a blogpost with comments will every new comment cause an alert or only blogpost changes?<p>I don&#x27;t have a good solution for this problem yet. Let the user specify a css selector or xpath?
watson超过 10 年前
Is it only for HTML, or will it alert on changes to JavaScript files for instance?
评论 #8531059 未加载
girishso超过 10 年前
I just built &quot;Page Poller&quot; for the Rails Rumble 2014, same concept! <a href="http://pagepoller.r14.railsrumble.com/" rel="nofollow">http:&#x2F;&#x2F;pagepoller.r14.railsrumble.com&#x2F;</a>
ideaoverload超过 10 年前
Looks very similiar to <a href="https://followthatpage.com" rel="nofollow">https:&#x2F;&#x2F;followthatpage.com</a> . Worked for me pretty well for non JS pages for last 3 years.
sleepingspider超过 10 年前
&gt; Does it diff binary data.. for example, if I ask it to watch an image url will it hash the image and notify me when it gets updated?<p>Can you elaborate in what case you might want to do this?
akx超过 10 年前
Typo in the footer: &quot;Sleeping Sider&quot;
评论 #8513082 未加载
评论 #8510810 未加载
评论 #8510796 未加载
callesgg超过 10 年前
What is regarded as a change?
评论 #8510856 未加载
seivui超过 10 年前
Which timezone does &quot;8 o&#x27;clock in the morning&quot; consider?
评论 #8510809 未加载
评论 #8510792 未加载
sleepingspider超过 10 年前
Just added HTTP authentication support.
zapt02超过 10 年前
Nice branding!
_asciiker_超过 10 年前
simple, clean and useful. I&#x27;m trying it out. Good job!