Hello all,
I need of a distributed web crawler + indexing, that can take care of crawls of any size. For example the crawler must be able to crawl & indexing a single website (few web pages) as well as the whole web (over a billion web pages).
Installation & configuration : Apache Nutch
Thank you
Hi sir,
This is Lin and I am scraping expert, i have checked all details for your project. can we discuss more info then i can provide example data for you?
Please message me then we can discuss more ASAP.
Thanks,
Lin