Building an efficient neural language model over a billion words

Oh, that was so yesterday I did that last year with my laptop...oh wait I can't eavesdrop on a billion people's private conversations.