Oxen.ai: Fast Unstructured Data Version Control

Oh man, if this could plug into git and be a LFS replacement, that would be awesome. I work in a field where folks run into situations where they think they need LFS, and rarely does it work out well. If someone can figure out an ergonomic and durable LFS-like blob versioning system that can align with git histories, that would be incredible.

How does this compare with other systems, like DVC (<a href="https:&#x2F;&#x2F;dvc.org&#x2F;" rel="nofollow">https:&#x2F;&#x2F;dvc.org&#x2F;</a>) for example?

The comparison with DVC is biased <a href="https:&#x2F;&#x2F;github.com&#x2F;Oxen-AI&#x2F;oxen-release&#x2F;blob&#x2F;main&#x2F;Performance.md">https:&#x2F;&#x2F;github.com&#x2F;Oxen-AI&#x2F;oxen-release&#x2F;blob&#x2F;main&#x2F;Performanc...</a><p>I&#x27;d nowhere near the same performance with oxen. The analysis is very biased to help Oxen. I wish people had more integrity before trying so hard to push a half-baked product into the market.

Link to the actual project source <a href="https:&#x2F;&#x2F;github.com&#x2F;Oxen-AI&#x2F;Oxen">https:&#x2F;&#x2F;github.com&#x2F;Oxen-AI&#x2F;Oxen</a>

Great to see more people in this space! We are the authors of XetHub (posted in Dec ‘22, ShowHN: <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=33969908" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=33969908</a>) and also think a git-like workflow is perfect for ML dataset management, except that we actually integrate with git (like LFS). &lt;A quick benchmark suggests we are 2x your published performance!&gt;

On your github org, twitter link is pointing to the wrong handle:<p>@oxen_ao -&gt; @oxen_ai

Being realistic here, 3rd party provider for data handling will be a no-go for many firms, for infosec reasons. Whereas a hub with no ui might also be a no-go for convenience reasons. I understand that oxenhub is a way to monetise the project but is there a self-hosted &#x27;enterprise&#x27; version of that anywhere in the plans?

Any plans for adding exclusive locking and option to delete old versions of a file? These are really important if working with unmergeable, large files.

Web hub (similar to GitHub): <a href="https:&#x2F;&#x2F;www.oxen.ai&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.oxen.ai&#x2F;</a>

What are the differences between this and DVC?

I see there are already a bunch of questions about how this compares to other tools like DVC, dolt, pachyderm.io and LFS? I would just like to add one to that list:<p>How does this compare to lakeFS?

How does it compare to dolt?<p><a href="https:&#x2F;&#x2F;github.com&#x2F;dolthub&#x2F;dolt">https:&#x2F;&#x2F;github.com&#x2F;dolthub&#x2F;dolt</a>

Please implement account deletion, you are violating people&#x27;s privacy, GDPR and this is a dark pattern.

How does this compare to Pachyderm.io?

why not just use git?