I skimmed through this and have already found a bunch of interesting sections, but there's also a ton of background information on topics related to bandit algorithms.<p>The authors say that this is the first draft of the book submitted to the publisher, so I suppose it's nearly complete?
More details available at the site they put up, <a href="http://banditalgs.com/" rel="nofollow">http://banditalgs.com/</a>