All are welcome, what seems to be in short supply is stuff at either end, the fundamentals and what a master student might encounter.<p>To briefly explain why I'm asking this, and why the answers may be of value to others in this community:<p>I'm trying to break into AI, to understand a large amount of the theory you effectively have to be well versed in statistics. I come from an engineering background where it's really more understanding abstract concepts at speed and applying them correctly with frameworks. While I understand a lot can be achieved by going through projects in TensorFlow and doing some Googling, I feel like I don't understand the internals. Thanks for taking the time to read this.
"𝗘𝗹𝗲𝗺𝗲𝗻𝘁𝘀 𝗼𝗳 𝗦𝘁𝗮𝘁𝗶𝘀𝘁𝗶𝗰𝗮𝗹 𝗟𝗲𝗮𝗿𝗻𝗶𝗻𝗴" 𝗯𝘆 𝗛𝗮𝘀𝘁𝗶𝗲, 𝗧𝗶𝗯𝘀𝗵𝗶𝗿𝗮𝗻𝗶, & 𝗙𝗿𝗶𝗲𝗱𝗺𝗮𝗻<p>This is one of the clearest and most respected statistics books ever written.<p>I personally owe the start of my machine learning career to this book!<p>You will find so many people around the world (online and IRL) who consider this the bible for statistical learning.<p>It is so readable, and yet filled with gems and insights from one of the world's most preeminent statisticians.<p>Free PDF: <a href="http://ow.ly/v5Uw50obzpO" rel="nofollow">http://ow.ly/v5Uw50obzpO</a><p>Datasets & code: <a href="http://ow.ly/a8UZ50obzpN" rel="nofollow">http://ow.ly/a8UZ50obzpN</a><p>R Code: <a href="http://ow.ly/EEdf50kXUBS" rel="nofollow">http://ow.ly/EEdf50kXUBS</a><p>Videos: also available at various sources.
For a "Stats 101" experience:<p><a href="https://www.youtube.com/playlist?list=PL5102DFDC6790F3D0" rel="nofollow">https://www.youtube.com/playlist?list=PL5102DFDC6790F3D0</a><p>For Probability Theory:<p><a href="https://www.youtube.com/playlist?list=PLUl4u3cNGP60hI9ATjSFgLZpbNJ7myAg6" rel="nofollow">https://www.youtube.com/playlist?list=PLUl4u3cNGP60hI9ATjSFg...</a><p><a href="https://www.youtube.com/playlist?list=PL2SOU6wwxB0uwwH80KTQ6ht66KWxbzTIo" rel="nofollow">https://www.youtube.com/playlist?list=PL2SOU6wwxB0uwwH80KTQ6...</a>
I agree you'll definitely want to read Elements of Statistical Learning but there are a few more, namely Think Stats and Think Bayes.<p>Since no one has really said much about Bayes yet, I think it worth mentioning just how useful it is in DS and ML. A Bayesian approach makes a very good baseline and often one that is hard to beat.<p>If you're not particular fluent with Probability and Statistics now, let me suggest you add in Khan Academy (make sure to pick the CLEP version) and JBstatistics. Khan has the advantage of quizzes (so you're not just kidding yourself that you know the material). JBstatistics has the advantage of really good explanations. You'll probably want to watch Khan at x1.5 speed.
Ian Goodfellow has a nice free book that includes an "applied math and machine learning basics" section that gives a nice overview of linear algebra, probability theory etc that make it a nice starting point. It's also specifically written for software engineers I believe:
<a href="https://www.deeplearningbook.org/" rel="nofollow">https://www.deeplearningbook.org/</a>
I think your question is I want to understand the math behind all of this: I would start by doing Andrew Ng's courses on ml and DL at Coursera<p>Math is wide for AI and moves into multiple disciplines such as calculus, linear algebra.<p>Once you have done the above courses you can dive accordingly
<a href="http://sgsa.berkeley.edu/current_students/books/" rel="nofollow">http://sgsa.berkeley.edu/current_students/books/</a>
“All of Statistics” by Larry Wasserman is a very good - if concise - introduction to statistics. Doesn’t require too much background, although the problems can get pretty hairy. Unfortunately, many of the proofs in the field are based on “tricks” that accumulate, which makes the learning curve steeper for people who don’t have as much background in finding/using these tricks.
This is a easy, short and classic read: <a href="https://www.google.com/books/edition/Cartoon_Guide_to_Statistics/sjUcgxEz4x0C?hl=en&gbpv=1&printsec=frontcover" rel="nofollow">https://www.google.com/books/edition/Cartoon_Guide_to_Statis...</a><p>EDIT: Also very basic. Should have added that.