<i>> ...and a really good simulated environment that captures the problem you’re solving.</i><p>The original "data is the new oil" quote was pointing out that raw data, like raw oil, requires lots of processing/refinement before the raw resource becomes something with a lot of economic value and potential [1].<p>In that sense, simulated environments are the oil of deep RL.<p>Deep RL has a lot of promise (and obv is already delivering on that promise). But when it comes to the need for high-fidelity and accurate models, we're out of the frying pan and into the fire.<p>[1] <a href="https://medium.com/@TalPerry/on-labeled-data-85fbaf1bdf89" rel="nofollow">https://medium.com/@TalPerry/on-labeled-data-85fbaf1bdf89</a>