Also, did you get permission from craigslist to index their listings? I was looking into building something like this, but their terms said something along the lines of "don't access our site with a crawler unless we give you permission".
Also, did you get permission from craigslist to index their listings? I was looking into building something like this, but their terms said something along the lines of "don't access our site with a crawler unless we give you permission".
As to Craigslist - we'll see? We actually built a pretty robust classification engine that you can run on any html, so we've added about 600 dealerships in California and are planning on running the crawler on dealerships nationally soon if we can get more server money. I think we're hoping that if we provide a free service where you can see what better deals Craigslist has compared to Autotrader etc people will generally think its cool instead of lame. Thanks for checking us out!