TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN: Labfile, a declarative file format for orchestrating experiments

3 pointsby rorytbyrne6 months ago
Hi friends.<p>I used to be a software architect&#x2F;technical founder, but now I&#x27;m doing a PhD in neuroscience. One big culture shock was that much of computational science is still imperative, while software engineering shifted to declarative tools decades ago.<p>Many scientists (myself included) run Python scripts manually and track the inter-dependencies in their heads - often running scripts in the wrong order and getting silently incorrect results (leading to Nature papers).<p>This problem seems similar to managing infrastructure with Terraform or building an image with Dockerfile directives, so I&#x27;ve started sketching out a declarative file format for defining experiments, their hyperparameters, and their relationships.<p><a href="https:&#x2F;&#x2F;github.com&#x2F;FlywheelHQ&#x2F;labfile">https:&#x2F;&#x2F;github.com&#x2F;FlywheelHQ&#x2F;labfile</a><p>My hope is to change this workflow:<p>```bash<p>$ python script1.py ...<p>$ python script3.py &lt;--- fuck, forgot to re-run script 2 ...<p>$ python script2.py ...<p>$ python script3.py ...<p>```<p>into this<p>```bash<p>$ lab Labfile<p>Using cached results for Exp1.<p>Running Exp2... Done.<p>Running Exp3... Done.<p>```<p>This library is just a parser, but I&#x27;m working on an orchestrator and will share it soon.<p>I would appreciate feedback on the syntax (I&#x27;m sure it sucks), and thoughts on what kinds of tooling could be built on top of a file format like this. I&#x27;d also like contributors (soon).<p>Side note: You might have noticed it&#x27;s published under &quot;Flywheel&quot;. This is a org I started recently with my friend, hoping to create the missing incentives for talented builders to work on tools for science - an often overlooked part of the tech ecosystem. That includes policy change (in the UK), funding, education, and some other things. I don&#x27;t know what Flywheel is yet (non-profit? OSS collective? a fund of some sort?) since it&#x27;s very new, but we have a website: <a href="https:&#x2F;&#x2F;flywhl.dev" rel="nofollow">https:&#x2F;&#x2F;flywhl.dev</a>.

no comments

no comments