I need a program which will search the web starting with every domain, [login to view URL] [login to view URL] [login to view URL], [login to view URL], [login to view URL] ... [login to view URL] [login to view URL] etc. Incrementing one alphanumeric character until every domain has been searched for their [login to view URL] and [login to view URL] to a certain domain name length has been searched. I want to compile a list of all the classified sites on the internet. Not just newspapers, but buying and selling type classifieds. I want the list of classified sites outputed to a file. The output must be a CVS file with 1 field as the URL. 1 field as a the html page name. 1 field what version of classified software it is running, like phpboard or phpbb etc. You could make this either with linux and a shell script or make it for windows. Either way is fine. You must be able to set the delay between queries and timeout values. I would like to max it out on my computer and connection but without crashing up the computer. It should run for several days until it is done with all of them until the length i specify, ie 20 character long domains will try all of the alphanumeric characters and dashes. I must also be able to specify if it searching .com, .net, .us, .org, .in, etc.