The suggestions for empirical evaluation are great, but would have to be insisted upon by reviewers, often chosen by authors and complicit in promoting the larger methodology at stake. I’ve seen this happen in methodology publications several times.<p>It makes sense though for companies to do this evaluation, and a ML PaaS that automates those empirical evaluations across a range of methods might have a uniquely useful service.