TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Open source cloud file system. Posix, HDFS and S3 compatible

197 pointsby wiradikusumaover 2 years ago

16 comments

filleokusover 2 years ago
How does it compare to other players in the area? E.g Ceph, Gluster or Seaweed? (I&#x27;m no expert myself, only used those as a consumer of already setup systems)<p>EDIT: There is a whole comparison section in the docs that I missed: <a href="https:&#x2F;&#x2F;juicefs.com&#x2F;docs&#x2F;community&#x2F;comparison&#x2F;juicefs_vs_cephfs&#x2F;" rel="nofollow">https:&#x2F;&#x2F;juicefs.com&#x2F;docs&#x2F;community&#x2F;comparison&#x2F;juicefs_vs_cep...</a>
评论 #34706733 未加载
评论 #34727581 未加载
评论 #34720272 未加载
评论 #34716396 未加载
评论 #34708266 未加载
tyingqover 2 years ago
&gt;JuiceFS has introduced S3 gateway since v0.11. The feature is implemented based on the MinIO S3 Gateway.<p>The MinIO S3 Gateway was deprecated: <a href="https:&#x2F;&#x2F;blog.min.io&#x2F;deprecation-of-the-minio-gateway&#x2F;" rel="nofollow">https:&#x2F;&#x2F;blog.min.io&#x2F;deprecation-of-the-minio-gateway&#x2F;</a><p>I don&#x27;t know if JuiceFS is treating it like a fork that they are maintaining, or if they have other plans.
评论 #34707078 未加载
truth_seekerover 2 years ago
Adopted SeaweedFS few months back. Never looked back since then. It&#x27;s fast even on HDD disks.<p><a href="https:&#x2F;&#x2F;github.com&#x2F;seaweedfs&#x2F;seaweedfs#introduction">https:&#x2F;&#x2F;github.com&#x2F;seaweedfs&#x2F;seaweedfs#introduction</a>
评论 #34709739 未加载
评论 #34707957 未加载
评论 #34707617 未加载
评论 #34708812 未加载
VikingCoderover 2 years ago
&gt; 99.99999999% (10 9s) reliability SLA<p>Can someone tell me in practical terms what that means?<p>1 second of unreliability every 317 years?
评论 #34708386 未加载
Lucasoatoover 2 years ago
Do you know if strong read-after-write consistency is supported (as in s3)? Is an atomic put-if-absent method supported in JuiceFS (as in Azure blob storage)? If so, this could be a really cool platform for formats like Delta.io :)
评论 #34706750 未加载
评论 #34707098 未加载
margorczynskiover 2 years ago
Regarding the topic of &quot;cloud storage&quot; - could someone tell me if Juice or maybe MinIO would be a good solution to: 1. Storing multimedia data (image&#x2F;video) uploaded by an user - here I would guess it can either hit it directly or via the backend for auth 2. Should be accessible by an URL exposed outside of the docker-compose so it doesn&#x27;t need to go through the backend REST API 3. Some form of authentication based on the JWT token in the Header - or maybe as this is a MVP simply generating a long enough random string will be enough<p>Or should I simply use nginx + filesystem and not overcomplicate?<p>I hear everywhere S3 but as it&#x27;s a pet project don&#x27;t want to go the AWS route, instead maybe a Hetzner VPS with docker-compose to run the whole setup with an external Postgres instance.
评论 #34715992 未加载
Jamie9912over 2 years ago
I tried putting Postgres on JuiceFS and let&#x27;s just say.. it didn&#x27;t perform very well
评论 #34706992 未加载
评论 #34713361 未加载
ltbarcly3over 2 years ago
Is it &#x27;Posix Compatible&#x27; or &#x27;Posix&#x27; aka &#x27;Posix compliant&#x27;?<p>It&#x27;s incredibly hard to make a distributed posix compatible filesystem since you run into CAP. I believe (but am not certain) you are caching locally in violation of Posix or you are signing up for arbitrarily long stalls and a ton of latency on every read&#x2F;write. (I&#x27;m not certain because I&#x27;m not sure what Posix specifies wrt stale reads and other cache consistency requirements between sync&#x27;s)<p>It would be interesting to hear what the tradeoffs are here, but assuming they are explicit and can be designed around this seems very useful.
评论 #34714303 未加载
评论 #34718617 未加载
siliconc0wover 2 years ago
I was actually building something similar to Juice using S3 as an object store and optionally using redis(fast) or s3(slow) for metadata storage. Basically a log structured filesystem using rolling hash chunk encoding and delegations. I kinda stopped when I found juice (and to some extent seaweed) as they were much further along. If you need shared storage and don&#x27;t have crazy performance requirements it makes a lot of sense to separate out metadata and just throw blobs into object storage.
bilekasover 2 years ago
I tried to take a look into the documentation but it seems to all be in Chinese?<p>Edit: For some reason my phone defaulted to Chinese but on my laptop it&#x27;s fine. User error I guess!
hardwaresoftonover 2 years ago
Does JuiceFS scale horizontally? I can’t see anything about how the servers federate&#x2F;balance load or if they can at all.<p>[EDIT] looks like there&#x27;s an issue -- <a href="https:&#x2F;&#x2F;github.com&#x2F;juicedata&#x2F;juicefs&#x2F;issues&#x2F;345">https:&#x2F;&#x2F;github.com&#x2F;juicedata&#x2F;juicefs&#x2F;issues&#x2F;345</a><p>But this still doesn&#x27;t really answer it -- if I run JuiceFS S3 Gateway in 2 places, is there any way to redirect reads?
评论 #34720594 未加载
imhoguyover 2 years ago
Can it do full encryption from client (transfer + at-rest) with Fuse?<p>Currently I use ext4 image + LUKS + NBD over SSH tunel, it works but is extremely slow.
评论 #34709277 未加载
throwawayapplesover 2 years ago
Is this basically a non-POSIX* FUSE for S3 and&#x2F;or Redis?<p>* POSIX implies a whole lot of guarantees, like atomic file renames&#x2F;moves, that definitely don&#x27;t seem to be included here.
评论 #34718498 未加载
ParadisoShleeover 2 years ago
I run a mastodon instance, and can imagine hosting the storage of multiple instances on a juicefs S3 gateway... needs dedupe because I consider that
评论 #34727150 未加载
jenka93over 2 years ago
Does it support POSIX ACLs as well?
评论 #34707117 未加载
omgwtfusbover 2 years ago
I can&#x27;t seem to find docs in a language other than Chinese on the site
评论 #34706572 未加载