Hi, thanks for submitting. I'm the developer of the app! Happy to answer any questions<p>(I was going to write up a medium post about the technical side of building the app but haven't gotten a chance yet)
Did something similar some time back before ARKit and vision frameworks were around.<p>Are you using the rectangle detection from Vision?
<a href="https://www.youtube.com/watch?v=wt96OomJY9A" rel="nofollow">https://www.youtube.com/watch?v=wt96OomJY9A</a>
Other good ideas:<p>- point at a board game and either do all the boring scorekeeping for me, or else advise me on best strategy<p>- take a photo of a bunch of lottery tickets and tell me whether I've won
I remember using Google Goggles for this back in 2011 or so.<p>The cool new thing is projecting the solution onto the paper and having it track correctly!
Wow, I was at a hack night and saw a demo by someone who had made exactly this type of app on his computer using its webcam. He built a neural network and trained it, and it could even handle angles that weren't straight on. I don't think he's the same guy, but yeah, it's a clever idea.