TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Show HN: Tesoro – Personal internet archive

174 点作者 agamble将近 8 年前

27 条评论

JackC将近 8 年前
For personal web archiving, I highly recommend <a href="http:&#x2F;&#x2F;webrecorder.io" rel="nofollow">http:&#x2F;&#x2F;webrecorder.io</a>. The site lets you download archives in standard WARC format and play them back in an offline (Electron) player. It&#x27;s also open source and has a quick local setup via Docker - <a href="https:&#x2F;&#x2F;github.com&#x2F;webrecorder&#x2F;webrecorder" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;webrecorder&#x2F;webrecorder</a> .<p>Webrecorder is by a former Internet Archive engineer, Ilya Kreymer, who now captures online performance art for an art museum. What he&#x27;s doing with capture and playback of Javascript, web video, streaming content, etc. is state of the art as far as I know.<p>(Disclaimer - I use bits of Webrecorder for my own archive, perma.cc.)<p>For OP, I would say consider building on and contributing back to Webrecorder -- or alternatively figure out what Webrecorder is good at and make sure you&#x27;re good at something different. It&#x27;s a crazy hard problem to do well and it&#x27;s great to have more ideas in the mix.
评论 #14645184 未加载
评论 #14645173 未加载
评论 #14648472 未加载
评论 #14647435 未加载
评论 #14645590 未加载
评论 #14645083 未加载
smoyer将近 8 年前
It&#x27;s not mine unless it&#x27;s running on my own servers or computer - I created a really rough version of this several years ago that is saved to my computer (and from there into box).
评论 #14644902 未加载
评论 #14647080 未加载
Piskvorrr将近 8 年前
That&#x27;s just as much &quot;my own&quot; as The Internet Archive: a website Out There somewhere. Worse, it&#x27;s much more likely to rot and disappear than archive.org. Now, if I could run this <i>locally</i>...<p>(Yes, yes, `wget --convert-links`, I know. Not quite as convenient, though.)
评论 #14644520 未加载
评论 #14645153 未加载
评论 #14648312 未加载
j_s将近 8 年前
I would be interested in an attestation service that can provide court-admissable evidence that a particular piece of content was publically accessible on the web at a particular point in time via a particular url.<p>I believe the only way to incentivise participation in such a system is by paying for timestamp&#x27;ed signatures, eg. &quot;some subset of downloaded [content] from [url] at [time] hashed to [hash]&quot; all tucked into a Bitcoin transaction or something. There are services that will do this with user-provided content[1]; I am looking for something that will pull a url and timestamp the content.<p>This would also be a way to detect when different users are being served different content at the same url, thus the need for a global network of validators.<p>[1] <a href="https:&#x2F;&#x2F;proofofexistence.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;proofofexistence.com&#x2F;</a>
评论 #14647633 未加载
unicornporn将近 8 年前
In what way could this considered to be “your own internet archive”? I see no way to register a user and save pages to a collection.<p>If you really want to create <i>your own</i> archive, set up a Live Archiving HTTP Proxy[1], run SquidMan [2] or check out WWWOFFLE[3].<p>If you want something simpler, have a look at Webrecorder[4] or a paid Pinboard account with the “Bookmark Archive”[5].<p>[1] <a href="http:&#x2F;&#x2F;netpreserve.org&#x2F;projects&#x2F;live-archiving-http-proxy&#x2F;" rel="nofollow">http:&#x2F;&#x2F;netpreserve.org&#x2F;projects&#x2F;live-archiving-http-proxy&#x2F;</a><p>[2] <a href="http:&#x2F;&#x2F;squidman.net&#x2F;squidman&#x2F;index.html" rel="nofollow">http:&#x2F;&#x2F;squidman.net&#x2F;squidman&#x2F;index.html</a><p>[3] <a href="http:&#x2F;&#x2F;www.gedanken.org.uk&#x2F;software&#x2F;wwwoffle&#x2F;" rel="nofollow">http:&#x2F;&#x2F;www.gedanken.org.uk&#x2F;software&#x2F;wwwoffle&#x2F;</a><p>[4] <a href="https:&#x2F;&#x2F;webrecorder.io&#x2F;" rel="nofollow">https:&#x2F;&#x2F;webrecorder.io&#x2F;</a><p>[5] <a href="https:&#x2F;&#x2F;pinboard.in&#x2F;upgrade&#x2F;" rel="nofollow">https:&#x2F;&#x2F;pinboard.in&#x2F;upgrade&#x2F;</a>
评论 #14644979 未加载
评论 #14645964 未加载
rahiel将近 8 年前
An internet archive can only provide value if it&#x27;s there for the long-term. What&#x27;s your plan to keep this service running if it gets popular? For example, archive.is costed about $2000&#x2F;month at the start of 2014 [1]. I expect it to cost even more now.<p>[1]: <a href="http:&#x2F;&#x2F;blog.archive.is&#x2F;post&#x2F;72136308644&#x2F;how-much-does-it-cost-you-to-host-a-website-of" rel="nofollow">http:&#x2F;&#x2F;blog.archive.is&#x2F;post&#x2F;72136308644&#x2F;how-much-does-it-cos...</a>
venning将近 8 年前
Thoughts:<p>I like the look. Very clean. I like how fast it&#x27;s responding; better than archive.org (though, obviously, they have different scaling problems).<p>&quot;Your own internet archive&quot; might be overselling it, as other commenters have pointed out; the &quot;Your&quot; feels a bit misleading. I think &quot;Save a copy of any webpage.&quot; gives a better impression, which you use on the site itself.<p>The &quot;Archive!&quot; link probably shouldn&#x27;t work if there&#x27;s nothing in the URL box. It just gives me an archive link that errors. Example: [1]<p>Using it on news.YC as a test gave me errors with the CSS &amp; JS [2]. This might be due to the fact that HN uses query parameters in their CSS and JS, which repeat in the tesoro URL, which you may not be parsing correctly.<p>Maybe have something in addition to an email link for submitting error reports like the above, just cause I&#x27;d be more likely to file a GitHub issue (even if the repo is empty) than send a stranger an email.<p>As other commenters have pointed out, archive.is also does this, and their longevity helps me feel confident that they&#x27;ll still be around. Perhaps, if you wish to differentiate, offer some way for me to &quot;own&quot; the copy of the page, like downloading it or emailing it to myself or sharing it with another site (like Google Docs or Imgur) to leverage redundancy, or something like that. Just a thought.<p>All in all, nice Show HN.<p>EDIT: You also may want to adjust the header to work properly on mobile devices. Still though, nice job. Sorry if I&#x27;m sounding critical.<p>[1] <a href="https:&#x2F;&#x2F;archive.tesoro.io&#x2F;320b55cc9b78e271c94716ee23554da8" rel="nofollow">https:&#x2F;&#x2F;archive.tesoro.io&#x2F;320b55cc9b78e271c94716ee23554da8</a><p>[2] <a href="https:&#x2F;&#x2F;archive.tesoro.io&#x2F;a7bf03e247224bc3b4e5a7c1f2ad42b1" rel="nofollow">https:&#x2F;&#x2F;archive.tesoro.io&#x2F;a7bf03e247224bc3b4e5a7c1f2ad42b1</a>
评论 #14644961 未加载
bfirsh将近 8 年前
What&#x27;s the best way to automatically archive all of the data I produce on websites? Facebook, Twitter, Instagram, blogs, and so on. At some point these services will disappear, and I want to preserve them.<p>I know a lot of these sites have archiving features, but want something centralised and automatic.
评论 #14646533 未加载
评论 #14646927 未加载
akerro将近 8 年前
Nice, post it on <a href="https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;DataHoarder&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;DataHoarder&#x2F;</a><p>They will love it!
zippoxer将近 8 年前
Cool tool, but by using it, you depend on it staying alive for longer than any page you archive on it.<p>This got me thinking about how a decentralized p2p internet archive could solve the trust problem that exists in centralized internet archives. Such solution could also increase the capacity of archived pages and the frequency at which archived pages are updated.<p>It is true that keeping the entire history of the internet on your local drive is likely impossible, but a solution similar to what Sia is doing could solve this problem: split each page to 20 pieces and distribute each piece to 10 peers such that every y pieces can recover the original page. So, you only have to trust that 10 peers out of 20 that store a page are still alive to get the complete page.<p>The main problem I can see right now would be lack of motivation to contribute to the system -- why would people run nodes? Just because it would feature a yet another cryptocurrency? Sure, this could hold now, but when the cryptocurrency craze quiets down and people stop buying random cryptocurrencies just for the sake of trading them, what then? Who would run the nodes and why?
评论 #14647200 未加载
j_s将近 8 年前
The discussion 3 months ago on bookmarks mentioned several options for archiving pages (some locally): <i>Ask HN: Do you still use browser bookmarks?</i> | <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=14064096" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=14064096</a><p>extensions: Firefox &quot;Print Edit&quot; Addon &#x2F; Firefox Scrapbook X &#x2F; Chrome Falcon &#x2F; Firefox Recoll<p>open source: Zotero &#x2F; WorldBrain &#x2F; Wallabag<p>commercial: Pinboard &#x2F; InstaPaper &#x2F; Pocket &#x2F; Evernote &#x2F; Mochimarks &#x2F; Diigo &#x2F; PageDash &#x2F; URL Manager Pro &#x2F; Save to Google &#x2F; OneNote &#x2F; Stash &#x2F; Fetching<p>public: <a href="http:&#x2F;&#x2F;web.archive.org" rel="nofollow">http:&#x2F;&#x2F;web.archive.org</a> &#x2F; <a href="https:&#x2F;&#x2F;archive.is&#x2F;" rel="nofollow">https:&#x2F;&#x2F;archive.is&#x2F;</a>
idlewords将近 8 年前
You&#x27;re going to get this service shut down if you let anonymous people republish arbitrary content while running everything on Google.<p>I (obviously) think personal archives are a great idea, but republishing is a hornets&#x27; nest.
Retr0spectrum将近 8 年前
Is this any different to archive.is?<p>If I want my <i>own</i> archive, Ctrl+S in Firefox usually works fine for me.
crispytx将近 8 年前
You know your site actually does a better job reproducing webpages than archive.org. I&#x27;ve noticed that if you use a CDN to serve up CSS &amp; JS for a webpage that you&#x27;re trying to archive on archive.org, it won&#x27;t render correctly. On your site, there doesn&#x27;t seem to be a problem including CSS &amp; JS from an external domain. Thumbs up :)
评论 #14645236 未加载
zichy将近 8 年前
So this is like archive.is, but I can&#x27;t search through archived sites?
CM30将近 8 年前
When you said &#x27;own internet archive&#x27; I thought you meant some sort of program you could download that&#x27;d save your browsing history (or whatever full website you wanted) to your hard drive. I think that would have been significantly more useful here.<p>As is it, while it&#x27;s a nice service, it&#x27;s still got all the issues of other archive ones:<p>1. It&#x27;s online only, so one failed domain renewal or hosting payment takes everything offline.<p>2. It being online also means I can&#x27;t access any saved pages if my connection goes down or has issues.<p>3. The whole thing is wide open to having content taken down by websites wanting to cover their tracks. I mean, what do you do if someone tells you to remove a page? What about with a DMCA notice?<p>It&#x27;s a nice alternative to archive.is, but still doesn&#x27;t really do what the title suggests if you ask me.
jpalomaki将近 8 年前
This might be a good use case for distributed storage (IPFS?).<p>Instead of hosting this directly on my computer, it would be interesting to have a setup where the archiving is done via the service and I would just provide somewhere a storage space where the content would end up being mirrored (just to guarantee that my valuable things are saved at least somewhere, should the the other nodes decide to remove the content).<p>I would prefer this setup, because it would be easily accessible for me from any device and I would not need to worry about running some always available system. With some suitable P2P setup my storage node would have less strict uptime requirements.
评论 #14651826 未加载
dbz将近 8 年前
This is pretty cool. I have a chrome extension that let&#x27;s you view the cached version of a web page [1]. Would I be able to use this through an API? I currently support Google Cache, WayBack Machine, and CoralCDN, but Coral doesn&#x27;t work well and I&#x27;d like to replace it with something else.<p>[1] <a href="https:&#x2F;&#x2F;chrome.google.com&#x2F;webstore&#x2F;detail&#x2F;cmmlgikpahieigpcclckfmhnchdlfnjd" rel="nofollow">https:&#x2F;&#x2F;chrome.google.com&#x2F;webstore&#x2F;detail&#x2F;cmmlgikpahieigpccl...</a>
评论 #14645003 未加载
prirun将近 8 年前
I think you should explain why you&#x27;re paying Google to archive web pages for others, ie, how do plan on benefiting from this? If you have some business model in mind, let people know now. It&#x27;s the first question that comes to my mind when someone offers a service that is free yet costs the provider real money. You obviously can&#x27;t pay Google to archive everyone&#x27;s web pages just for the fun of it.
评论 #14645078 未加载
评论 #14645157 未加载
gorbachev将近 8 年前
You should try and rewrite relative links in websites that get archived. I tested your app with a news site, and all the links go to archive.tesoro.io&#x2F;sites&#x2F;internal&#x2F;url&#x2F;structure&#x2F;article.html<p>I also second the need for user accounts. If I am to use your site as my personal archive, then I would need to log in and create a collection of my own archived sites.
arkenflame将近 8 年前
I made a simple Chrome extension to automatically save local copies of pages you bookmark, if you prefer that instead: <a href="https:&#x2F;&#x2F;chrome.google.com&#x2F;webstore&#x2F;detail&#x2F;backmark-back-up-the-page&#x2F;cmbflafdbcidlkkdhbmechbcpmnbcfjf" rel="nofollow">https:&#x2F;&#x2F;chrome.google.com&#x2F;webstore&#x2F;detail&#x2F;backmark-back-up-t...</a>
lozzo将近 8 年前
it would be nice to have a bit of explanation on how it works and why we can be confident that we can rely upon it
评论 #14644772 未加载
jdc0589将近 8 年前
&gt; Tesoro saves linked assets, such as images, Javascript and CSS files.<p>I&#x27;m confused. It looks like image sources in &quot;archived&quot; pages on Tesoro still point back to the origin domain.<p>Edit: it works as expected. I just didn&#x27;t notice the relative paths.
评论 #14646124 未加载
salmonfamine将近 8 年前
Worth noting that Tesoro is the name of a major oil&#x2F;fuel company in Texas.
NicoJuicy将近 8 年前
When a company went down, i downloaded every one of their clients with httrack and wget. Just to be sure their clients wouldn&#x27;t lose their site. ( and some other things)<p>I wonder what this site uses
pbhjpbhj将近 8 年前
How are you handling copyright infringement? Outside USAs Fair Use terms this looks like pretty blatant infringement.
评论 #14645241 未加载
评论 #14647690 未加载
skdotdan将近 8 年前
Nice. How are you planning to pay the servers? Your service seems quite storage-intensive.
评论 #14648353 未加载