TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

A Programmer's Guide to Data Mining

399 点作者 carlosgg超过 11 年前

18 条评论

TrainedMonkey超过 11 年前
While scanning table of contents, I was like this is simple stuff. But then I dived in a chapter and I was converted. This is good because it shows you how to use all those techniques in a real world, with examples mining data from twitter and Facebook streams. Probably best hands on guide I saw for data mining/sentiment analysis.
评论 #6870242 未加载
terramars超过 11 年前
before i say anything directly about the book, i&#x27;d like to point out that for simple systems (like these), the most challenging parts are overwhelmingly data collection, normalization &#x2F; featurization, and model testing, rather than actually creating or using models. while there are rare cases where a simple solution (hey, let&#x27;s throw naive bayes at it) will give you a good answer, these are almost always because someone did a very good job collecting and sanitizing the input. furthermore, stuff like the twitter movie sentiment analysis - while great in theory - rarely ends up doing what you expect in practice. product recommendation and collaborative filtering are proven to work very well in practice, but sentiment systems are a totally different monster.<p>onto the book - it looks promising for an intro to recommendation systems. no opinion about classification yet. doesn&#x27;t appear to have anything on graphs or network effects which is somewhat disappointing. that being said i need to review bayesian stuff &#x2F; teach myself some of the harder stuff and it will be nice to have a practical walkthrough.<p>that being said no one should be implementing these themselves (except the dumb stuff like distance metrics).. it&#x27;s useful to learn but scikit-learn is amazing when it comes to fancy algorithms.
ville超过 11 年前
This looks nice. I&#x27;ve also heard many recommendations for the book Programming Collective Intelligence[1], which touches the same subjects and also has examples in Python. Now I&#x27;m tempted to read both :)<p>[1]: <a href="http://shop.oreilly.com/product/9780596529321.do" rel="nofollow">http:&#x2F;&#x2F;shop.oreilly.com&#x2F;product&#x2F;9780596529321.do</a>
评论 #6869770 未加载
评论 #6869771 未加载
natebod超过 11 年前
Looking through chapter 6 on Bayesian Classifiers. I do not think it is correct from page 52. He appears to be using the p.d.f of the standard normal distribution for point estimators. I have training in classical&#x2F;frequentist stats, so correct me if I&#x27;m wrong, but probability estimates from a pdf are given by the area under the curve, the value at a point is meaningless. In fact the probability at a given point is always zero.
评论 #6872107 未加载
pigscantfly超过 11 年前
As an alternative for anyone who wants to delve a little further into data mining, I&#x27;m currently taking the Stanford data mining class, STATS202. The book we&#x27;re using has been really great (published this year) and covers a great deal more than this site seems to. It&#x27;s called &quot;An Introduction to Statistical Learning with Applications in R.&quot; It&#x27;s free online through the Stanford libraries, but I&#x27;m not sure about accessing it for free elsewhere. The lectures are also probably recorded online somewhere, if anyone is really interested.
评论 #6869879 未加载
SeppoErviala超过 11 年前
Check out gensim if you want to do topic modeling or similarity comparisons in Python.<p><a href="http://radimrehurek.com/gensim/" rel="nofollow">http:&#x2F;&#x2F;radimrehurek.com&#x2F;gensim&#x2F;</a><p>It has good implementations of various algorithms, some of which support streaming or dirstribution, and it allows loading and dumping data in various formats.<p>I&#x27;ve used it for building content based recommender using tf-idf, lsi and similarity index. After the index is built, queries to it are really fast. It can handle quite large corpuses with little memory.
评论 #6870342 未加载
评论 #6872840 未加载
crandles超过 11 年前
This is from one of my college professors, nice to see it make it on HN, and it looks like there&#x27;s a bit more material since I used it in class. I found it helpful in explaining basic concepts (more-so than the bland textbook that I had to pay for).
garraeth超过 11 年前
I just scanned it but it looks awesome! Thanks for putting this together! I didn&#x27;t look terribly hard but did you mention the work of Ziegler and Golbeck: &quot;Investigating interactions of trust and interest similarity&quot;? It&#x27;s a bit old (2006) but I think it&#x27;s a great reference for real-world engines and helped me a ton back in the day.
sown超过 11 年前
This is neat! Fantastic, even! The math is less theoretical and more systems oriented. The choice of python, modern psuedocode that runs, is great, too. The naive Bayes chapter is useful, too. One might want to look at Udacity&#x27;s AI course for more info about this topic or as a supplement. Bayes seems to be one of those things where the math is short and difficult; I&#x27;ve been reading about it recently, myself. Just practice, I guess. To engineer stuff with it you may not need to understand it perfectly (until you get bugs ;). Anyways, it&#x27;s still good. It&#x27;s a hard topic and Bayes law&#x2F;tricks appear in AI often so it&#x27;s worth knowing more about.<p>Thank you, Ron Zacharski!<p>(disclaimer: you do not want my opinion regarding any topic).
gautamnarula超过 11 年前
This looks great! Is there an email list or any other way I can get notifications as new material is added&#x2F;revised?
sushirain超过 11 年前
After reading chapter two, my conclusion is that this book is also suitable for high-school level. Not many books simplify things so much as this book. The Python implementation even avoids Numpy, which makes it very easy to understand (even though using Numpy is more practical).
frik超过 11 年前
Is the code also available in C like syntax? (C, C++, PHP, JS, etc)<p>Porting Python code can be painful. (I checked the chapter 7 py file and it isn&#x27;t filled with functional style code, though various kinds of arrays with index starting with 1 or so may still be an issue)
评论 #6869224 未加载
评论 #6870372 未加载
评论 #6872383 未加载
cmao3超过 11 年前
My feeling is that it&#x27;s very interesting book even for high school kids.
karangoeluw超过 11 年前
This is awesome. How about a PDF with all chapters combined?
lovegratisbooks超过 11 年前
As of January 5, 2014, the pdf for this book will be available for free, with the consent of the publisher, on the book website.
nashequilibrium超过 11 年前
I actually went through this book almost two years ago, i remember the author did not finish it, but i enjoyed it! Thanks!
ewharton超过 11 年前
This is great - I love that it&#x27;s in Python
LambdaAlmighty超过 11 年前
Not bad as an introductory text, but the code could use some love. Disappointing when it says &quot;programmer&#x27;s&quot; in the title.<p>Ever heard of PEP8 for Python coding style? List comprehensions?<p>I&#x27;m afraid this falls in no man&#x27;s land, with code too weak for practitioners and theory too weak for theoreticians.
评论 #6871653 未加载
评论 #6872387 未加载