We are looking someone to create some web scappers (crawlers) .
We need capture data from a URL
Minimize traffic (don't check URLs 2 times)
Prepare data (encode UTF8, clean text input...)
and automatization (we can launch and stop every time we need)
No proxy required
We pay per each crawler.
want to be the best for this project.................................................................................................................................................................................................................................................................................................................................................................................