TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Garage: Open-Source Distributed Object Storage

518 点作者 n3t10 个月前

21 条评论

makkesk810 个月前
We moved over to garage after running minio in production with about ~2PB after about 2 years of headache. Minio does not deal with small files very well, rightfully so, since they don&#x27;t keep a separate index of the files other than straight on disk. While ssd&#x27;s can mask this issue to some extent, spinning rust, not so much. And speaking of replication, this just works... Minio&#x27;s approach even with synchronous mode turned on, tends to fall behind, and again small files will pretty much break it all together.<p>We saw about 20-30x performance gain overall after moving to garage for our specific use case.
评论 #41015305 未加载
评论 #41019275 未加载
j-pb10 个月前
What I&#x27;m really missing in this space is something like this for content addressed blob storage.<p>I feel like a lot of complexity and performance overhead could be reduced if you only store immutable blobs under their hash (e.g Blake3). Combined with a soft delete this would make all operations idempotent, blobs trivially cacheable, and all state a CRDT&#x2F;monotonically mergeable&#x2F;coordination free.<p>There is stuff like IPFS in the large, but I want this for local deployments as a S3 replacement, when the metadata is stored elsewhere like git or a database.
评论 #41015952 未加载
评论 #41016984 未加载
评论 #41014837 未加载
评论 #41016475 未加载
评论 #41015260 未加载
评论 #41015072 未加载
评论 #41016084 未加载
评论 #41014993 未加载
评论 #41019708 未加载
评论 #41016030 未加载
评论 #41032265 未加载
评论 #41016126 未加载
评论 #41018106 未加载
评论 #41016203 未加载
computerfan49410 个月前
I have used Garage for a long time. It&#x27;s great, but the AWS sigv4 protocol for accessing it is just frustrating. Why can&#x27;t I just send my API key as a header? I don&#x27;t need the full AWS SDK to get and put files, and the AWS sigv4 is a ton of extra complexity to add to my projects. I don&#x27;t care about the &quot;security benefits&quot; of AWS sigv4. I hope the authors consider a different authentication scheme so I can recommend Garage more readily.
评论 #41013663 未加载
评论 #41013335 未加载
评论 #41017047 未加载
评论 #41014345 未加载
评论 #41014886 未加载
评论 #41013352 未加载
TechDebtDevin10 个月前
SeaweedFS is great as well.<p><a href="https:&#x2F;&#x2F;github.com&#x2F;seaweedfs&#x2F;seaweedfs">https:&#x2F;&#x2F;github.com&#x2F;seaweedfs&#x2F;seaweedfs</a>
评论 #41014499 未加载
评论 #41013884 未加载
fijiaarone10 个月前
I don’t understand why everyone wants to replicate AWS APIs for things that are not AWS.<p>S3 is a horrible interface with a terrible lack of features. It’s just file storage without any of the benefits of a file syste - no metadata, no directory structures, no ability to search, sort, or filter.<p>Combine that with high latency network file access and an overly verbose API. You literally have a bucket for storing files, when you used to have a toolbox with drawers, folders, and labels.<p>Replicating a real file system is not that hard, and when you lose the original reason for using a bucket —- because your were stuck in the swamp with nothing else to carry your files in — why keep using it when you’re out of the mud?
评论 #41013827 未加载
评论 #41013440 未加载
评论 #41015805 未加载
评论 #41015018 未加载
评论 #41013372 未加载
评论 #41013447 未加载
评论 #41014433 未加载
评论 #41015329 未加载
评论 #41013355 未加载
评论 #41013486 未加载
评论 #41013282 未加载
neon_me10 个月前
Whats the motivation behind project like this one?<p>We got ceph, minio, seaweedfs ... and a dozen of others. I am genuinly curious what is the goal here?
评论 #41019304 未加载
评论 #41014935 未加载
评论 #41016685 未加载
Daviey10 个月前
Last time I looked at Garage it only supported paired storage replication, such that if I had a 10GB disk in location A and a 1TB disk is location 2 and 3, it would only support &quot;RAID1-esq&quot; mirroring, so my storage would be limited to 10GB
评论 #41015450 未加载
sunshine-o10 个月前
I really appreciate the low memory usage of Garage compared to Minio.<p>The only thing I am missing is the ability to automatically replicate some buckets on AWS S3 for backup.
storagenerd10 个月前
Check out this one - <a href="https:&#x2F;&#x2F;github.com&#x2F;NVIDIA&#x2F;aistore">https:&#x2F;&#x2F;github.com&#x2F;NVIDIA&#x2F;aistore</a><p><a href="https:&#x2F;&#x2F;aiatscale.org&#x2F;" rel="nofollow">https:&#x2F;&#x2F;aiatscale.org&#x2F;</a><p>It is an object storage system and more..
dtag0010 个月前
A bit of an off-topic question: I would like to programmatically generate S3 credentials that allow only read access or r&#x2F;w access to only a certain set of prefixes. Imagine something like &quot;Dropbox&quot;: You have a set of users, each user has his own prefix, but also users want to be able to share certain prefixes with other users. (Users are managed externally in a Postgres DB - MinIO does currently not know about them).<p>I found this really difficult to achieve with MinIO, since this appears to require an AssumeRole request, which is almost not documented in any way and I did not find a Typescript example. Additionally, there&#x27;s a weird set of restrictions in place for MinIO (and also AWS) that makes this really difficult to do, e.g. the size of policies is limited, which effectively limits the number of prefixes a user can share. I found this really difficult to work around.<p>Can anyone suggest a way to do this? Can garage do this? Am I just approaching this from the wrong side?<p>Thanks
arcanemachiner10 个月前
GitHub mirror: <a href="https:&#x2F;&#x2F;github.com&#x2F;deuxfleurs-org&#x2F;garage">https:&#x2F;&#x2F;github.com&#x2F;deuxfleurs-org&#x2F;garage</a>
icy10 个月前
I&#x27;ve been running this on K3s at home (for my website and file server) and it&#x27;s been very well behaved: <a href="https:&#x2F;&#x2F;git.icyphox.sh&#x2F;infra&#x2F;tree&#x2F;master&#x2F;apps&#x2F;garage" rel="nofollow">https:&#x2F;&#x2F;git.icyphox.sh&#x2F;infra&#x2F;tree&#x2F;master&#x2F;apps&#x2F;garage</a><p>I find it interesting that they chose CRDTs over Raft for distributed consensus.
评论 #41018859 未加载
moffkalast10 个月前
Finally one can launch startups from their own Garage again.
MoodyMoon10 个月前
Apache Ozone is an alternative for an object store running on top of Hadoop. Maybe someone who has experience running this in a production environment can comment on it.<p><a href="https:&#x2F;&#x2F;ozone.apache.org&#x2F;" rel="nofollow">https:&#x2F;&#x2F;ozone.apache.org&#x2F;</a>
CyberDildonics10 个月前
What is the difference between a &quot;distributed object storage&quot; and a file system?
评论 #41013807 未加载
评论 #41014671 未加载
评论 #41014997 未加载
surfingdino10 个月前
There&#x27;s also OpenStack Swift.
评论 #41015787 未加载
seaghost10 个月前
I want something very simple to run locally that has s3 compatibility just for the dev work and testing. Any recommendations?
评论 #41015964 未加载
评论 #41015968 未加载
评论 #41028790 未加载
thecleaner10 个月前
Ist this formally verified by any chance ? I feel like there&#x27;s space where formal designs could be expressed in TLA+ such that its easier for the community to keep track of the design.
评论 #41020013 未加载
comvidyarthi10 个月前
Is this open source ?
评论 #41013511 未加载
anonzzzies10 个月前
NLNet sponsored a lot of nice things.
评论 #41015510 未加载
bluepuma7710 个月前
Can it be easily deployed with old-school Docker Swarm?
评论 #41021530 未加载