Find Jobs
Hire Freelancers

Create Google Site Search Crawler for Jonathan Siennicki

$250-750 USD

已关闭
已发布大约 6 年前

$250-750 USD

货到付款
The Jonathan Siennicki Project: Create a software in the language C or C++ (or script like in python or php) that is multi threaded, supports http and https proxys - and able to scrape Google, Yahoo, & Bing results to identify Google Site Search (and competing sites like [login to view URL], Algolia, etc) by the javascript and/or various footprints used. (similar to scraping Google results to see which sites have Google Analytics) Crawled results will filter out duplicates of top level domains (TLD). So if there is a www. or just a TLD domain, we want to only use one. Tasks: 1. Identify contact page. (most often [login to view URL] and/or [login to view URL], but can vary) Scrape the contact name (if appears), the email addresses, and the telephone numbers. This information should be saved in a Excel file. Would love it if could also submit to wordpress sites, etc and perhaps support captcha api for that purpose. Lots of code on github/sourceforge for this. 2. Extract WHOIS Contact information and if possible, also on the websites Contact page. The only thing we want is the website, contact name, email address and telephone number of webmaster. The software will have an option to save the output according to the search engine it was crawled from in Excel, CVS or TXT. 3. The software should have a built in WYSIYG editor, and support multiple SMTP credentials and proxys for sending emails, and have the ability to do the scraping and task the emails immediately thereafter. Menu Options of Software: Define how many sites to crawl. Define tasks related to emails. There should be a menu to output success/error logs, which search engines to crawl (all are defaulted), which search engines to use (all are defaulted), ability to configure additional footprints, and produce output of results (compile database) in excel or CVS format. Also, the menu should show how many proxies are working, and should randomly use them when extracting from search engines. Output: For example, if we selected "Google Site Search" and used "Google, Bing and Yahoo" to get the results, we should be able to create a database based on that. By default, all search engines are used to find all the results for each 'site search' platform and duplicate domains are erased before following up with checking for website CONTACT and WHOIS info Note: There is tons of open source for proxies, scraping, WHOIS lookups, etc and everything written here on Sourceforge and Github. So this is like a lego. If you can create the Jonathan Siennicki software, please let me know the language (can be web, but preferably a binary application). Please give a price, time of delivery, and also any software resume you have to convince us your the right person for the job. We've prepared a document that is attached with various footprints of the various platforms offering a similar service to Google Site Search.
项目 ID: 16532957

关于此项目

11提案
远程项目
活跃6 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
11威客以平均价$481 USD来参与此工作竞价
用户头像
Hello. I am full experience with C++ C C# dotnet aspnet and windows desktop application development. You will be satisfied with my great result. I can implement google search crawler Best regards
$555 USD 在10天之内
4.7 (45条评论)
6.2
6.2
用户头像
with 10 years experience in Wordpress, PHP, Woocommerce, SEO. I can help you finish projects which you probose. we can communicate each other easily.
$666 USD 在10天之内
5.0 (5条评论)
2.7
2.7
用户头像
 11+ Years of IT experience  Extensive knowledge in Full stack web development using HTML5, CSS3, LESS, SASS, Postcss, JavaScript, ES6, JQuery, ReactJS, Redux, flux, D3, NodeJS, Angular 2.0, GUI desings, webpack, Gulp, Java and Python.  Good knowledge on data structures and algorithms in JavaScript  Strong proficiency in JavaScript, including DOM manipulation and the JavaScript object model  Thorough understanding of React.js and its core principles  Good understanding of Google Cloud and AWS  Good knowledge on Google Cloud data storage, API, BigQuery, Cloud SQL and App Engine  Good knowledge in designing GUI  Experience with popular React.js workflows (such as Flux or Redux)  Experience with common front-end development tools such as Babel, Webpack, NPM  Proficient in building Web User Interface (UI) using HTML5, DHTML, table less XHTML, CSS3 and Java Script that follows W3C Web Standards and are browser compatible  Experienced in building cross browser compatibility applications using HTML5 and CSS3.  Good knowledge in MVC architecture and understanding concepts on Model, View, controllers  Expertise in debugging and troubleshooting existing code using Developer Tools like Firebug, chrome, IE explorer and Safar  Extensively used ES6 new features  Based on the functional requirements, designed component state diagram for React  Worked web accessibility issues  Involved in designing Responsive web design  Involved in Web UI architecture
$555 USD 在15天之内
0.0 (0条评论)
0.0
0.0

关于客户

ISRAEL的国旗
Budapest, Israel
5.0
1
付款方式已验证
会员自7月 5, 2006起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。