TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ugarit: content-addressable storage and backup written in Chicken scheme

43 pointsby landakramalmost 8 years ago

6 comments

ChuckMcMalmost 8 years ago
Very nice. Content addressable storage has a number of wonderful properties. At Blekko we would hash &#x27;keys&#x27; (like a URI) which would identify a &#x27;bucket&#x27; where that URI was stored. This spread crawling the web evenly across multiple servers.<p>At Netapp I worked for a bit on a content addressable version of a filer where each 4K block was hashed and the hash became the block address. Unlike Ugarit the block hashes were in an SSD based metadata server rather than being hashed into directories. The feature that fell out of this was you got content deduplication for &#x27;free&#x27; since any block that hashed to a particular code you already had stored you didn&#x27;t need to store again. (and this exploited the fixed length defense against hash collisions).
评论 #14640423 未加载
beagle3almost 8 years ago
Sounds very close to bup&#x2F;git and borg. In many ways, git is a content addressable storage with a couple of metadata, remote synchronization and merging features mixed in. bup uses git&#x27;s internals to great effect for a backup system, and borg drops git compatiblity and elegant multi-client support, but goes farther by providing other backup functionality such as efficient pruning and built in encryption.
zmixalmost 8 years ago
Problem with this is, that the last development seems to have happened in 2015 and the issue tracker is pretty full with stuff going back to 2012.
评论 #14666298 未加载
dragonshedalmost 8 years ago
If the author or a contributor is able to share, I&#x27;m curious how thia compares to camlistore.
nix0nalmost 8 years ago
How do you handle hash collisions?
评论 #14648001 未加载
评论 #14648002 未加载
pmoriartyalmost 8 years ago
I wonder how performant, mature, and reliable this is.
评论 #14666320 未加载