Crawling videos from internet
$250-750 CAD
货到付款
I would like to build an application using either node.js or Grails to Crawl the videos from the websites listed below. The application is able to parse the web page and identify if the web page contains video content (excluding ads). If it does, store the url, video description, title, and uploaded date in a NoSQL (possibilly Mongo) database. The application and database is hosted in AWS cloud. The application runs twice a day. The database contains no duplicate urls.
Business Insider: [login to view URL]
Fortune Magazine:
Forbes
The Economist
WSJ Business
Bloomberg
The Street
Consumerist
Financial Times
项目ID： #9618422
关于项目
有9名威客正在参与此工作的竞标，均价$702/小时
Hello, I have experience in Grails as well as nodejs but I will prefer crawling using nodejs with mongodb database. Let me know good time to discuss with you
I got 7+years work experience in Data Collection,Bulk Email Campaign,Excel VBA and Internet Research in IT companies here.I can do create script and scrap datas from the sites using C++,C#,Java,Python and Perl codi 更多
Hello, I have developed several application similar to this one in Node.JS and I'm sure I'll be able to deliver what you expect from the project. Don't hesitate to contact me.
experiences mongo or couchbase php5 or node.js config linux server nginx web server yii framework or pure php
