Hey HN,<p>Looking for recommendations on books, courses or projects to learn natural language processing. I have a background in statistics so I understand things like probability, linear/logistic regression, and k-means clustering, but not much about NLP. Ideally would like to slowly work my way towards understanding text-generation and how models like GPT-3 were built.<p>Thanks!
In late 2017 I got enough of a feel that NLP was moving fast to figure I had better get acquainted with it. I had a technical background, but nothing in NLP.
About two years later, I wrote an article with a practical roadmap to learning NLP [1].<p>A few months later I write a no-maths explainer to transformer models (BERT and GPT-2.) [2] GPT-3 is basically the same but bigger. ChatGPT is a little different).<p>Recently, I wondered what, if anything, I'd change about these, given where we are with NLP today. The only thing I'd say is getting acquainted with the HuggingFace ecosystem.<p>[1] <a href="https://towardsdatascience.com/learn-nlp-the-practical-way-b854ce1035c4" rel="nofollow">https://towardsdatascience.com/learn-nlp-the-practical-way-b...</a><p>[2] <a href="https://towardsdatascience.com/the-abba-explainer-to-bert-and-gpt-2-ada8ff4d1eca" rel="nofollow">https://towardsdatascience.com/the-abba-explainer-to-bert-an...</a>