TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Xvc: A CLI tool to manage data and ML pipelines in Rust (GPL3)

2 pointsby emresahin8 months ago

1 comment

emresahin8 months ago
Xvc is an alternative to Git-LFS, git-annex (in data management) and DVC (in data and pipelines management.)<p>- Track binary&#x2F;unstructured data and artifacts along with the code<p>- Run pipelines composed of steps depending on files, globs, URLs, SQLite queries, regexes, hyperparameter files etc. (in parallel)<p>- Store binary data files with local, rsync and S3 compatible storages, separately from Git repository<p>- Automates git commands to commit tracked metadata files but can also work without git