TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Interpreting neurons in an LSTM network

141 pointsby nicolrxalmost 8 years ago

1 comment

fnbralmost 8 years ago
So, this is definitely good work, and I don&#x27;t have any suggestions on how to do it better, but I&#x27;m ultimately not sure how useful I find it. I have no intuition for what the histograms for `t` should look like, and so seeing the different histograms for ծ vs `not ծ` doesn&#x27;t tell me much except that they&#x27;re different (which is trivially true!).<p>Does anyone else find this sort of visualization useful? Maybe I&#x27;m just misunderstanding this. I would love to develop more of an intuition for neuron activations in deep nets- I want to better understand how they work, as right now, the only thing that I do is feed in inputs and look at the outputs, which is wildly inadequate.<p>I have the same criticism when it comes to the CNN visualizations that Karpathy et. al [1] came up with. They&#x27;re cool, but I don&#x27;t find them that useful.<p>I hope I don&#x27;t sound too critical. I&#x27;m really glad that people are doing this sort of work, as I think that it&#x27;s incredibly important to the advancement of deep learning, and I think that this work is well-done, but I don&#x27;t find it personally useful.<p>[1]: <a href="https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1506.02078" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1506.02078</a>