PyTorch: An Imperative Style, High-Performance Deep Learning Library [pdf]

Finally the solution to all of your PyTorch citation problems! :)

Man it’s kinda sad as a Lua fan to see so much interest in a project where the main goal is just to not use Lua.<p>I guess academics like familiarity and Lua insistently refuses to be like other languages (arrays and maps in one type, 1-based arrays, nonstandard builtin patterns, etc).

If you want to read it online - <a href="https:&#x2F;&#x2F;www.arxiv-vanity.com&#x2F;papers&#x2F;1912.01703&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.arxiv-vanity.com&#x2F;papers&#x2F;1912.01703&#x2F;</a>

Is there a typo in Listing 1?<p>The forward function of the conv net should use:<p>t3 = self.fc(t2)<p>instead of:<p>t3 = self.fc(t1)<p>AFAIK the nn.functional.relu function is NOT inplace by default [1]<p><a href="https:&#x2F;&#x2F;pytorch.org&#x2F;docs&#x2F;stable&#x2F;nn.functional.html" rel="nofollow">https:&#x2F;&#x2F;pytorch.org&#x2F;docs&#x2F;stable&#x2F;nn.functional.html</a>

It&#x27;s a bit funny to call it imperative, when really at the end of the day, the objective is to get something where you have very little insight into what the neural net. is doing to the state.