Extracting Super Mario Bros levels with Python

I made this a few years ago. It&#x27;s pretty much all of Super Mario Bros. in one image: <a href="https:&#x2F;&#x2F;i.imgur.com&#x2F;g6JQ2WV.png" rel="nofollow">https:&#x2F;&#x2F;i.imgur.com&#x2F;g6JQ2WV.png</a> &#x2F; <a href="https:&#x2F;&#x2F;twitter.com&#x2F;Doomlaser&#x2F;status&#x2F;1004802864433147904" rel="nofollow">https:&#x2F;&#x2F;twitter.com&#x2F;Doomlaser&#x2F;status&#x2F;1004802864433147904</a><p>I want to do more of these and experiment with training generative neural nets on that kind of thing when I get the chance.

Very nice. A few years back I wrote <a href="http:&#x2F;&#x2F;mariocraft.club&#x2F;" rel="nofollow">http:&#x2F;&#x2F;mariocraft.club&#x2F;</a> for fun (Super Mario in Javascript). Allows you to build your own levels. Very basic and unfinished but people love building levels.<p>If anyone has interest in picking up the project, and auto-generating the levels, ping me.

@matts_ramblings approach is great to get a perfect authoritative reference we can use to test and&#x2F;or train other tools.<p>Other tools mapping the Super Mario Bros. levels:<p>1. animmerger [1] by bisqwit<p>Written in C++.<p>Takes png images as input.<p>This tool seems to be the reference in creating level maps for Super Mario.<p>Matt&#x27;s tool seems to use animerger to generate the color palette according to the source code [2]<p>2. ALMA [3] by BZH314 (disclaimer: our baby project)<p>Matt mentions using this approach as a possibility in the post.<p>Written in Python using the OpenCV [4] computer vision library.<p>ALMA takes videos as input, generates the map levels as images (png and animated gifs) and also generates the videos to show the algorithm in action [5]<p>(shameless self plug: need more YouTube subscribers to get that sweet sweet vanity URL please :-)<p>ALMA applies background subtraction to remove the moving enemies in order to keep only the background (a problem Matt&#x27;s tool does not have)<p>3. Manually stitched<p>If you&#x27;re looking for good SMB1 level maps stitched manually, there are some good work out there:<p>Rick N. Bruns&#x27; nesmaps.com [6]<p>Mariowiki: example of World 1-1 [7]<p>Are you aware of other tools out there?<p>---<p>[1] <a href="https:&#x2F;&#x2F;bisqwit.iki.fi&#x2F;source&#x2F;animmerger.html" rel="nofollow">https:&#x2F;&#x2F;bisqwit.iki.fi&#x2F;source&#x2F;animmerger.html</a><p>[2] <a href="https:&#x2F;&#x2F;gist.github.com&#x2F;matthewearl&#x2F;733bba717780604813ed588d8ea7875f" rel="nofollow">https:&#x2F;&#x2F;gist.github.com&#x2F;matthewearl&#x2F;733bba717780604813ed588d...</a><p>[3] <a href="https:&#x2F;&#x2F;bzh314.com&#x2F;alma&#x2F;" rel="nofollow">https:&#x2F;&#x2F;bzh314.com&#x2F;alma&#x2F;</a><p>[4] <a href="https:&#x2F;&#x2F;opencv.org&#x2F;" rel="nofollow">https:&#x2F;&#x2F;opencv.org&#x2F;</a><p>[5] <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=wanvx0PpE1w&amp;list=PLa4uefpt5WhLxWtTluGVEP5utqysh_PDy" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=wanvx0PpE1w&amp;list=PLa4uefpt5W...</a><p>[6] <a href="http:&#x2F;&#x2F;www.nesmaps.com&#x2F;maps&#x2F;SuperMarioBrothers&#x2F;SuperMarioBrothers.html" rel="nofollow">http:&#x2F;&#x2F;www.nesmaps.com&#x2F;maps&#x2F;SuperMarioBrothers&#x2F;SuperMarioBro...</a><p>[7] <a href="https:&#x2F;&#x2F;www.mariowiki.com&#x2F;World_1-1_(Super_Mario_Bros.)" rel="nofollow">https:&#x2F;&#x2F;www.mariowiki.com&#x2F;World_1-1_(Super_Mario_Bros.)</a>

How difficult would it be to do the same with Super Mario World on the SNES?