I'm looking to develop a simple fare, hotel and car rental tool similar to kayak.com or mobissimo.com.<p>Both sites search hundreds of other travel sites, hotel chains and airlines, show the end-user the aggregated results in a nice way and then direct them to the original sources passing an affiliate id code so they can profit.<p>I assume that the majority of the sites they pull information from don't provide any kind of APIs.<p>Does anyone know how they might be able to pull this off?<p>I was wondering if there is a web service out there that gives you access to query the majority of these sites from an central API or if they are just having to scrape hundreds of sites individually.
Many of the flight-related sites use <a href="http://www.itasoftware.com/" rel="nofollow">http://www.itasoftware.com/</a> for fare and schedule querying.
I'm pretty sure they've worked out deals with each of the target sites and have access to some private APIs. Probably this only works if you can convince them you're going to send serious business their way.
An alternative is something like beautiful soup.<p><a href="http://www.crummy.com/software/BeautifulSoup/" rel="nofollow">http://www.crummy.com/software/BeautifulSoup/</a>