Are there any good books on debugging? I think debugging is one of the key skills of a good developer, but I have never seen a book (or blog) especially about debugging code and distributed systems.
Working Effectively With Legacy Code by Michael Feathers <a href="http://www.amazon.com/Working-Effectively-Legacy-Michael-Feathers/dp/0131177052" rel="nofollow">http://www.amazon.com/Working-Effectively-Legacy-Michael-Fea...</a><p>Debugging with GDB: The GNU Source-Level Debugger by Stallman, Pesch, and Shebs <a href="http://www.amazon.com/Debugging-GDB-GNU-Source-Level-Debugger/dp/1882114884/" rel="nofollow">http://www.amazon.com/Debugging-GDB-GNU-Source-Level-Debugge...</a><p>The Art of Debugging with GDB, DDD, and Eclipse by Matloff & Salzman <a href="http://www.amazon.com/gp/product/1593271743" rel="nofollow">http://www.amazon.com/gp/product/1593271743</a>
While there are great options mentioned here, I would actually be suggesting that you stick to a very good systems book. A standing knowledge of lower level systems and instruction code will give great depth to your debugging skills. Nothing teaches reverse engineering better than experience.<p>At CMU, we used CS:APP (Computer Systems: A Programmer's Perspective). It's written by Randy Bryant, the same professor who used to teach it. I still have that book, it's updated for Ivy Bridge, and I truly believe that this book changed my approach towards debugging more than any other text. It will push you to the next curve.<p>Towards the end of the book you'd find some programming labs. I highly suggest you do them religiously. Many great men have failed at them.
I've read a number of books on debugging, it's something of an interest of mine. The best general-purpose debugging book I've read is the cumbersomely named<p>Debugging: The 9 Indispensible Rules for Finding Even the Most Elusive Software and Hardware Problems by David J. Agans<p>Amazon link: <a href="http://www.amazon.com/Debugging-Indispensable-Software-Hardware-Problems/dp/0814474578/" rel="nofollow">http://www.amazon.com/Debugging-Indispensable-Software-Hardw...</a><p>What I really like about it is that it gives a number of high-level approaches to solving debugging problems and is written very accessibly.
Tess Ferrandez's blog is worth a look if you're doing .NET debugging (particularly outside of the IDE - she's a windbg wizard):<p><a href="http://blogs.msdn.com/b/tess/archive/tags/debugging/" rel="nofollow">http://blogs.msdn.com/b/tess/archive/tags/debugging/</a><p>She has written some labs covering common debugging scenarios:<p><a href="http://blogs.msdn.com/b/tess/archive/2008/02/04/net-debugging-demos-information-and-setup-instructions.aspx" rel="nofollow">http://blogs.msdn.com/b/tess/archive/2008/02/04/net-debuggin...</a>
I haven't read it, but a really smart ex-colleague is the author of 'Debug It': <a href="https://pragprog.com/book/pbdp/debug-it" rel="nofollow">https://pragprog.com/book/pbdp/debug-it</a>
"Debugging Applications" by John Robbins is an old MS Press book, now 43 cents on Amazon, that covers everything from high level code structure to a nice primer on reading x86 assembly. I have more recent books, but this is the one that taught me to gird my coding loins for a fight.
"Find the Bug: a Book of Incorrect Programs" by Adam Barr: <a href="http://www.amazon.com/gp/aw/d/0321223918/ref=mp_s_a_1_1?qid=1426946354&sr=8-1&keywords=find+the+bug&pi=AC_SY200_QL40&dpPl=1&dpID=51n%2B4Yc628L&ref=plSrch" rel="nofollow">http://www.amazon.com/gp/aw/d/0321223918/ref=mp_s_a_1_1?qid=...</a><p>It has a bunch of examples of bugs, classified by type of bug, and gives you tools for diagnosing and fixing them.
Giving tips very much depends on the language you're using and the capabilities of your debugger, having worked on large legacy VC++ projects knowing the "bad smells" and common mistakes to spot is helpful, but you'll struggle to debug projects you don't have a solid knowledge of.<p>To improve, try learning cracking; <a href="https://microcorruption.com/" rel="nofollow">https://microcorruption.com/</a> is a CTF game based around gaining access to embedded devices, it's rather fun too. I think what the most common mistake I find is two programmers having different assumptions on how some subsystem should work, so try improving your working memory as being able to remember the seemingly ok code 10 frames ago that conflicts with what's in front of you could be the key.<p>try:<p>Working Effectively with Legacy Code Martin, R.<p>API Design for C++ Reddy, M.<p>Were both full of indispensable advice.
There is a course on udacity called software debugging <a href="https://www.udacity.com/course/cs259" rel="nofollow">https://www.udacity.com/course/cs259</a>
Andreas Zeller, original author of GNU DDD, has a good book called "Why Programs Fail: A Guide to Systematic Debugging", 2nd edition.<p><a href="http://www.amazon.com/Why-Programs-Fail-Systematic-Debugging-ebook/dp/B0092L8LCW" rel="nofollow">http://www.amazon.com/Why-Programs-Fail-Systematic-Debugging...</a>
You need to understand how your system works and then get a good tool that allows you to observe its behavior in as much detail as possible.<p>I don't believe books are likely to be particularly relevant with the diversity of tools and platforms. Google the platform name plus 'debugging tool'. Then practice debugging.<p>If you have to, step through every single line of code and observe the program state closely at each step.<p>What kind of distributed system is it exactly? If it is a highly distributed system you can mock parts of it or find/ build a tool for fine-grain inspection and integrated reporting of the state of the system.<p>A book is not going to be able to keep up with platform and tool development.<p>You want to learn to Google, find good tools, practice a lot.
The Takipi blog deals a lot with debugging related issues: <a href="http://blog.takipi.com/" rel="nofollow">http://blog.takipi.com/</a><p>Some more posts worth checking out in the JVM domain:<p><a href="http://highscalability.com/blog/2015/1/7/the-ultimate-guide-5-methods-for-debugging-production-server.html" rel="nofollow">http://highscalability.com/blog/2015/1/7/the-ultimate-guide-...</a><p><a href="http://www.infoq.com/articles/Advanced-Java-Debugging-Techniques" rel="nofollow">http://www.infoq.com/articles/Advanced-Java-Debugging-Techni...</a><p>(Disclaimer: I'm from Takipi)
Somewhere on the internet the book "The Medical Detective" by Bertone Roueche should be a really good read about debugging. But I did not find a place on the internet where you can buy it. Here is a link to goodreads: <a href="http://www.goodreads.com/book/show/106164.The_Medical_Detectives" rel="nofollow">http://www.goodreads.com/book/show/106164.The_Medical_Detect...</a><p>Has anyone read this book and can recommend it?
Surprised this wasn't already mentioned, but the best description I've ever read of debugging is in Zen and The Art of Motorcycle Maintenance. (Unsurprisingly, it's about debugging motorcycles, but the author was a programmer so it's directly transferable)
Robert Ward, "Debugging C". There is a second edition with a somewhat different title that I have not read, but expect would be good.<p>He emphasizes the use of the scientific method - observe your program's behavior, form a hypothesis as to what the bug could be, design an experiment to test your hypothesis. Just learning to be methodical rather than thrashing around mindlessly helped me tremendously.<p>It's out of print but I expect you could find it on Alibris.