Posted about this separately (<a href="https://news.ycombinator.com/item?id=31743388" rel="nofollow">https://news.ycombinator.com/item?id=31743388</a>) thanks for pointing me to this post.<p>I used to work at Google where they have an internal tool called mldash. Was never able to find an equivalent user experience outside Google until now.<p>To be honest, I rarely need versioning for my datasets, and I had sort of put DVC into a bucket in my mind called "dataset versioning". For this reason, I have not really been a DVC user until now.<p>From what I see in this post, though, you guys are building a more cohesive experience around the common tasks that someone has to do in the course of training, deploying, and evaluating a machine learning model. Experiment tracking is a great place to start. Kudos.
Hi everyone, I’m one of the maintainers of Data Version Control – DVC (<a href="https://dvc.org" rel="nofollow">https://dvc.org</a>) – a popular open source tool for ML engineers. We’ve been building DVC for 5 years with a goal to bring software engineering best practices (version control, CI, and GitOps) to MLOps.<p>Today, VS Code is the fastest growing IDE among data scientists. That’s why we decided to bring DVC’s functionality natively to VS Code without any infrastructure overhead. We spent the past year building the DVC extension and I’m glad to present it to the community today.<p>In a nutshell, what DVC provides right from VS Code:
Experiment bookkeeping (an alternative to Tensorboard or MLFlow) that automatically saves metrics, graphs, hyperparameters and any other metadata. The feature allows you to compare the experiments and share with your teammates.<p>- Experiment reproducibility which allows you to pick any past experiment and use it as a foundation for a new set of experiments.<p>- Data management allows you to manage datasets, files, and models with data living in your favorite cloud storage: S3, Azure Blob, GCS, NFS, etc.<p>You can read here about the other tools that we’ve released: <a href="https://news.ycombinator.com/item?id=23759332" rel="nofollow">https://news.ycombinator.com/item?id=23759332</a><p>Watch this video to learn more about the extension <a href="https://youtu.be/LHi3SWGD9nc" rel="nofollow">https://youtu.be/LHi3SWGD9nc</a><p>If you use VS Code, please give it a try and let me know what you think. Any feedback is greatly appreciated <a href="https://marketplace.visualstudio.com/items?itemName=Iterative.dvc" rel="nofollow">https://marketplace.visualstudio.com/items?itemName=Iterativ...</a>