Immediately made me think of a question on the state of handwriting to LaTeX from a few years ago, and all the massive challenges involved:<p><a href="https://tex.stackexchange.com/questions/1443/what-is-the-status-of-generating-latex-from-handwriting-i-e-ocr" rel="nofollow">https://tex.stackexchange.com/questions/1443/what-is-the-sta...</a><p>Under API... you're already doing handwriting? This is uh, nontrivial work to say the least. Really impressive.<p>The endorsements are a nice touch. :)<p>Made me really curious how far the system goes, what cases break it.<p>Oh... nevermind. You have a PDF of examples here: <a href="https://docs.mathpix.com" rel="nofollow">https://docs.mathpix.com</a><p>It's honing in on equations without getting distracted by nearby Hanzi or Cyrillic, or even pictures of dogs. Wow.<p>I keep going back to dig through your resources and getting more impressed.<p>EDIT: I guess my only constructive criticism is that you should brag more. I like a simple landing page, but I think you've earned a short list of examples of corner cases you tackle well, if the whole API is packed into that free app, because they're really impressive.
This is really awesome OP! Thank you for sharing :)<p>One note I should make: it was not entirely clear (to me) upon a cursory view of the website, that the purpose of mathpix was to convert handwritten text into LaTeX. For some reason (maybe my coffee hasn't kicked in yet) I thought this was strictly intended to take screenshots of equations on an existing pdf document or a website etc and that will be converted to LaTeX.<p>My thought at that point was "I wonder if they could do this for handwritten text" and then I looked at the docs and facepalmed..
Stupid question, how well would this work on a PDF of a latex document?<p>This would be great for blind people, as pdfed latex is extremely non-accessable, and I have to email authors of papers to get the original latex from them, which is often lost.
Im curious if the developers are fans of The Big Bang Theory TV series? They were using a smart phone app...and of course was less useful due to it being fiction...<p><a href="https://www.springfieldspringfield.co.uk/view_episode_scripts.php?tv-show=big-bang-theory&episode=s04e12" rel="nofollow">https://www.springfieldspringfield.co.uk/view_episode_script...</a>
Wow!<p>What kind of sorcery is this!?<p>Is this using deep learning or "regular" OpenCV or similar?<p>I would assume it's a highly tuned deep learning algo, but I'm not knowledgeable enough to distinguish a deep learning algo from a pile of rocks...<p>Edit: Aha, someone already asked this and got an answer.<p><a href="https://news.ycombinator.com/item?id=16535467" rel="nofollow">https://news.ycombinator.com/item?id=16535467</a>
Suggestion: instead of making me download a pdf to see examples of what the results look like, maybe put them on the page directly. You can have a couple. Then put the details in the pdf.<p>Great software otherwise
This is fantastic!!<p>Bug report: it appears that multiline summation subscripts are not recognized correctly. For example, Eq. 8 of [1]. These are often created using \substack as part of amsmath.<p>Awesome tool!<p>[1]: <a href="https://arxiv.org/pdf/1802.01194.pdf" rel="nofollow">https://arxiv.org/pdf/1802.01194.pdf</a>
I assume you just got a lot of installs from India, because the large publishing houses contract out many re-typesetting jobs that are basically to take scans of technical texts and convert them back into LaTeX.<p>I strongly suggest you talk to the publishers about integrating your tech into their TeX.
Want a math-ish PDF and some LaTeX source for training on possible edge cases? Think I might get someone (or something) to read my dissertation this way...
Any way you could make this available outside the Mac App store? Apple seems to have decided I did something horrible and unforgivable by moving to a different country after creating an account, thus making it impossible for me to use the store.
Awesome! Is the plan for it to be free forever, or what might the pricing look like? Maybe you would consider open sourcing the model?<p>Also it would be nice of some info on the process. Does work entirely locally, or is images uploaded to the cloud?
We used their API to make a simple screenshot2latex tool (select screen region -> puts latex formula in clipboard). From my experience it still fails on a couple of fairly common things like:<p>- \mathcal letters (recognized as non-mathcal)<p>- long equations (not recognized at all)<p>- multi-line equations (not recognized at all)<p>The screenshot2latex tool: <a href="https://github.com/rmst/screenshot2latex/blob/master/scripts/screenshot2latex" rel="nofollow">https://github.com/rmst/screenshot2latex/blob/master/scripts...</a>
That's aweson OP. I can't imagine the number of times I've wished for something like this.<p>Coming from a grad student who hates writing equations in latex. I will probably try this out.
I was looking for an API that provides math OCR. Great, going to integrate it into our app soon :-) Let me know if you want to add us to your "trusted by" section.
Mathematicians use operator overloading all the time. It would be nice to have a tool that explains to me what an equation actually means in a given context.
This is insanely impressive. Great work. Wish tools like this existed when I was still in school...almost makes me want to go back and do some more math :)
I tried this on some of my (fairly neat) handwritten physics notes and it was mostly pretty impressive. Failures: a lot of lowercase deltas became 8s and it had no idea what to make of hbar (converting it to n, pi, k, or most often refusing to convert the equation entirely). A fair number of little typos, but you'd want to check all its work anyway.
The Newton quip is a missed opportunity to make a reference to Diamond, his favorite dog who burned up all his papers...<p><a href="https://en.wikipedia.org/wiki/Diamond_(dog)" rel="nofollow">https://en.wikipedia.org/wiki/Diamond_(dog)</a>
This is gold, great job. The one clear bug that I've noticed thus far is that it seems to correctly identify \hat{} but not finish it correctly when it also has an index, so that:
\hat { y _ { i } }
erroneously becomes:
\hat { y } _ { i }
This changes everything concerning my university life for me. I always was on the verge of doing everything digitally, but it was always cumbersome to type out (La)Tex by hand and convert handwritten notes to digital versions.<p>Thank you so much!
This is something I would have definitely used if I were still a student, although I'm not a fan of it being a Chrome extension. I'm still curious enough to test it out.
Very cool! I had this exact idea of a service a few years back, but was one of those things I never found the time or motivation to actually do. The results seem very nice.
This is great! it is very useful for writing papers. I tried it with some of my equations! It actually improved it by adding more approrpiate braces than I had.
I'm sorry if it's off the topic. The testimonials really cracked me up. “ If I had known about Mathpix earlier, perhaps I would have had enough time to work out the Grand Unified Theory. ” - Albert Einstein
So I guess I can expect to see more low quality mathematical typesetting. The technology is great, but I don't see how it will help with high quality typesetting.<p>I can type an equation into LaTeX more quickly that I can photograph it and then go in and manually correct all the spacing issues. And there are spacing issues. The examples PDF has things that just look horrible. No small spacing or negative spacing to space out things like matrices and integrals etc. If I'm going to manually tweak it anyway I might as well do it manually from the start. Typing it up is something that gets quicker with practice like everything else.<p>But what I can actually see happening is people not tweaking the output manually. Either train yourself to use TeX properly, or let someone do it for you.