Item2Vec: Neural Item Embedding for Collaborative Filtering

I don&#x27;t get the innovation in this paper - are they just running word2vec on groups of items? If so, Spotify has been doing this on playlists for years now: <a href="https:&#x2F;&#x2F;erikbern.com&#x2F;2013&#x2F;11&#x2F;02&#x2F;model-benchmarks&#x2F;" rel="nofollow">https:&#x2F;&#x2F;erikbern.com&#x2F;2013&#x2F;11&#x2F;02&#x2F;model-benchmarks&#x2F;</a><p>Also, I know the paper isn&#x27;t claiming state-of-the-art, but their SVD results are horrendous. Standard CF would create much better artist-artist pairings with even a medium sized dataset.<p>As an aside, I&#x27;ve run some quantitative and qualitative tests and have found the best recommendations come from a combination of user-item and item-item. I co-gave a talk at the NYC machine learning meetup recently (<a href="https:&#x2F;&#x2F;docs.google.com&#x2F;presentation&#x2F;d&#x2F;1S5Cizi9LFQ7l0bMYtY7gASvOPqxNsQk0-NuP5KWAl-4&#x2F;pub?start=false&amp;loop=false&amp;delayms=3000&amp;slide=id.p4" rel="nofollow">https:&#x2F;&#x2F;docs.google.com&#x2F;presentation&#x2F;d&#x2F;1S5Cizi9LFQ7l0bMYtY7g...</a>) that shows how this can work, starting at slide 20. The idea is to create a candidate list of matches using item-item, and then reorder using item-user. I&#x27;ve found this creates &quot;sensible&quot; suggestions using item-item, but truly personalizes when re-ordering. You can remove obvious recommendations by removing popular matches or matches the user has already interacted with (I consider this a business decision rather than something inherent in the algorithm).

Fascinating.<p>The qualitative comparison suggests that the item2vec may produce _more_ homogenous &#x2F; boring results, which is kinda unfortunate; the interesting question in recommendations is how to find &quot;aspirational&quot; recommendations (things the shopper would not have looked for on their own).<p>I would really love to see an analysis that did an A&#x2F;B test using more traditional CF and this, and see what the revenue lift was, because &quot;accuracy&quot; as measured here doesn&#x27;t necessarily map onto the objective that you care about in the real world.<p>On the other hand, I played with using collaborative filtering to improve the personalization of language models for speech recognition for shopping, and in that context this approach sounds like it might have been super useful, because it was actually fairly challenging to get broad enough coverage of the full set of items from a small number of purchases for the purposes of language modeling. Having good embeddings would have helped a lot.

I wonder if the item vectors capture semantics and behave in a way analogous to word vectors. So, for example, would a PS4 - a PS4 controller = an XBox - an XBox controller, the same way France - Paris = Greece - Athens? Something along these lines could maybe be used as a way to find relevant addons&#x2F;upsells to show on the checkout page.

Does anyone know good resources&#x2F;research about generating latent vector representations with iterative processes using numerical analysis algorithms and not neural networks?<p>The black-box effect on word2vec and similars puts back some applications like generalizing linguistics methods to bioinformatics.

This is a great model. I applied it to online retailer data and movies and it works amazingly well! much better than SVD++ or SVD. I have found it to perform very well on items with low usage too. I took the authors advice to change the window size dynamically according to the set size.

Github! This should be on github