TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Show HN: Minio – S3 Compatible Object Storage

49 点作者 iamclovin将近 9 年前

4 条评论

y4m4b4将近 9 年前
Hello HN,<p>Here is a bit more explanation about erasure code and bit-rot protection.<p>Minio along with being S3 compatible also protects data against hardware failures and silent data corruption using erasure code and checksums. You may lose roughly half the number ((N&#x2F;2)-1) of drives and still be able to recover the data.<p>Minio uses Reed-Solomon code to stripe objects into N&#x2F;2 data and N&#x2F;2 parity blocks. This means that in a 12 drive setup, an object is striped across as 6 data and 6 parity blocks. You can lose as many as 5 drives (be it parity or data) and still reconstruct the data reliably from the remaining drives.<p>Minio also supports bit-rot detection transparently which works along with erasure code using high speed BLAKE2 - <a href="https:&#x2F;&#x2F;github.com&#x2F;minio&#x2F;blake2b-simd" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;minio&#x2F;blake2b-simd</a> hash based checksums.
gregburd将近 9 年前
While I commend the developers of Minio for building what appears to be a functional S3-API-compatible system in Go Lang it seems to me to be missing the key thing that makes S3 a compelling object&#x2F;data storage solution -- the <i>distributed</i> part. Meaning, while I see that a Minio developer (y4m4b4) talks about erasure coding, something when talking about AWS&#x2F;S3 normally refers to the way data is encoded and replicated across nodes to mitigate outright data loss as well as bit rot, their description states &quot;You may lose roughly half the number of drives...&quot; -- &quot;drives&quot; not &quot;systems&quot; or &quot;nodes&quot;. This appears to be a single node solution, or have I overlooked the documentation describing how to join nodes together into a cluster? The description given is much more akin to RAID, which is fine and useful for distributing data across disks connected to a single system.<p>I hope that this is just an early announcement of a thing that is going to mature into a fully distributed solution, or that it is made clear that this is like SQLite (Minio is to AWS&#x2F;S3 as SQLite is to RDBMS systems [PostgreSQL, Oracle, etc.]) -- something intended to be smaller in scope and single node only. Leaving this fuzzy will lead to many people being confused and potentially someone depending on this system and later dealing with massive data loss when their drive or drives fail.<p>Could the developers of Minio please make a statement as to which direction they intending on going? Is this a single node S3-API compatible solution (which is valuable for a specific class of problems) or something that will eventually be designed to store data across 10s&#x2F;100s&#x2F;1000s of nodes geographically distributed all working together to maintain some degree of availability and data integrity?<p>What&#x27;s Minio going to be when it grows up? a) S3Lite b) S3
devplusops将近 9 年前
I tried minio and was really impressed with how easy it is to get started.<p>But I couldn&#x27;t figure out how to scale it or make it reliable. Having my entire system depend on a single server not going down is a non-starter for me. Do you consider this use case in-scope?<p>I&#x27;ve been looking at Skylable instead. While setting it up is a little clunky, it&#x27;s the only open source package I&#x27;ve found that explicitly supports replication across multiple datacenters - which is even more interesting to me than simply across servers within a data center.
评论 #12125822 未加载
unknownhad将近 9 年前
Wow this looks interesting. Nice job team minio
评论 #12123183 未加载