I poked around a bit on 538 on the day it relaunched, but hadn't read anything from there since then. Is this representative of the quality of articles? It seems just embarrassing as an example of data-driven journalism. They are evaluating the quality of a "big data" prediction algorithm based on 32 samples. The experimental setup is very odd, with such a short period of price tracking, a bizarre baseline strategy, and ending the trials early (over half right at the beginning!).<p>Or consider this gem: "For the five routes in which there was a financial benefit to waiting, Kayak successfully reduced my fare in each instance. [...] This is a sure sign of intelligence". Yes, of course if you cherry-pick 1/6 of the trials (a whole 5 of them!), the system will look effective. What kind of value is there in "analysis" of this level?