Build Backend Crawler Using Node.js
$2-8 USD/小时
We currently use a cloud service called Apifier.com. Their service is a crawler + a headless browser (PhantomJS) and allows us to inject our JavaScript code and return the result. Our script is returning the result from the site perfectly using their service but the problem with their service is that it has only instance of the headless browser and it is therefore too slow.
We are therefore considering another service called [url removed, login to view], which provides many or more headless browser (PhantomJS) instances with the same ability to inject our JavaScript code. However, Phantomjscloud does not offer a crawler, hence we need someone to write a crawler on our backend (Amazon Web Services) using Node.js. For your information, their API is very easy to understand. We also want you to evaluate the service from AWS Lambda and decide if this is something we should use for this project or not.
We hope that you have experience of writing Node.js crawlers before and we're are looking for CHEAP bidders. The project will have one milestone, which will be released when we know that the crawler returns the correct result in the form of JSON and can scrape 10,000's of pages in a feasible time.
We will provide you more information about the project through [url removed, login to view]'s messaging system. After that we need you to provide us with an estimate of number of hours required. The final invoice should not exceed the estimate you provide with more than 10%.
项目ID： #9228028
关于项目
有6名威客正在参与此工作的竞标，均价$9/小时
Hello. I have developed site for price compare. This site scrape data from many sites and use nodejs for scrape so I have many exprience with nodjs scrape. In addition, i have use phantomjs, casperjs before. Please hav 更多
Hi, If you'd like to just scrap the results then node.js is more that enough for this, but if you'd want to inject your own JavaScript then we have to use phantom/Casper js. also let me know if you'd like to scrap pred 更多
I'm building professional and freelance projects using many technologies including: PHP, Node.js, Go Lang, Bash, Python, Lua, MongoDb, Redis, Postgresql. Building web applications using PHP and Symfony2, Node.js and w 更多
Please, choose me. I'm have 3 year experience about phantomjs, cakephp, php,.... I'm will do work good best when you choose me. You can for me direct on freelancer website or skype: tuankiet2605 or gmail: tuankiet2605
