Ha very nice!<p>I made a vary similar (but much rougher around the edges) project for fun a few months ago using a smaller french corpus of press releases from <i>La Quadrature du Net</i> (a non-profit lobbying for net neutrality in France and Europe).<p>There is a live demo at <a href="http://jorquera.net/quadra_neural/" rel="nofollow">http://jorquera.net/quadra_neural/</a>. You can press tab to auto-complete word-by-word, or just start typing and the suggestions update on the fly. Instead of "Weirdness" I called my cursor "Drunkenness" :)<p>I used keras-js (<a href="https://github.com/transcranial/keras-js" rel="nofollow">https://github.com/transcranial/keras-js</a>) to run my model in the browser.<p>If you are interested in this kind of experiments, do go for it! It's quite accessible, and projects of this scale do not require heavy hardware (I generated my models using a GTX 770).<p>If you need a kickstart, in addition to the repo from the OP all the code for my project is Free Software (<a href="https://github.com/tomjorquera/quadra_neural" rel="nofollow">https://github.com/tomjorquera/quadra_neural</a>), and I tried to document the generation process in a jupyter notepad <a href="https://github.com/tomjorquera/quadra_neural/blob/master/generation/model_gen.ipynb" rel="nofollow">https://github.com/tomjorquera/quadra_neural/blob/master/gen...</a>. While I did it on a french corpus, it should work with any language.<p>I used two main resources for inspiration :<p>- <a href="http://karpathy.github.io/2015/05/21/rnn-effectiveness/" rel="nofollow">http://karpathy.github.io/2015/05/21/rnn-effectiveness/</a><p>- <a href="https://github.com/fchollet/keras/blob/master/examples/lstm_text_generation.py" rel="nofollow">https://github.com/fchollet/keras/blob/master/examples/lstm_...</a>