Hi everyone,<p>I have a crawler visiting urls forever.
I'm not really sure how to sell it or make it useful for others.<p>I use the information for several things , from expired domains, to find old wordpress, find sites using analytics 4...<p>It's an alpha, still fixing the search with an innodb table.<p>Have around 2.4M sites in the index.