I do part-time server admin & wonder how others monitor their webserver(s) for badly behaving bots like scrapers, DDoS, etc. What tools & procedures do you use & follow?
I appreciate your raising the question here, as maybe we can hear from people on front lines. There are, meanwhile, some interesting starting points at <a href="http://en.wikipedia.org/wiki/DDoS#Prevention_and_response" rel="nofollow">http://en.wikipedia.org/wiki/DDoS#Prevention_and_response</a>