TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Reflinks vs. symlinks vs. hard links and managing data in ML

10 pointsby ishchekleinalmost 6 years ago

2 comments

ternausalmost 6 years ago
I use Linux for more than 15 years and it is the first time I learned that such a thing as a reflink exists.<p>I use DVC for about a year on relatively large datasets (my expertise in Computer Vision and images are pretty heavy). I was always curious to know what is happening under the hood of the DVC, when it deals with the data in such a way that it is fast and cache is not corrupted.
ishchekleinalmost 6 years ago
It&#x27;s mentioning DVC inside it, I would be happy to discuss and answer any questions as one of the maintainers.