Create a web crawler connected to gmail

已完成 已发布的 Feb 23, 2016 货到付款
已完成 货到付款

The project is very simple.

Here is the full and exact description:

It should be a web script, running from a linux server via cronjob once every 15 minutes doing the following:

1. Login via IMAP to a gmail account

2. Grab all the emails with a spesific label

3. For each email extract 1 unique URL located within the contents of the email - it will be always the same domain name, different ending. for example: [url removed, login to view] or [url removed, login to view]

4. Each Email grabbed need to:

4.1 Change the label of the email to a different label

4.2 Create a new line in a simple mysql DB with the following data: Email date, Email title, the extracted link, Status

5. Each link is leading to a page that has 2 variations only - it's easy to distinguish which is it when crawling the URL because there are certain phrases to look for in the page, according to the variation the "Status" of this URL is determined and updated in the database

6. The script has to run every 15min and also check if the status of the "pending" has changed - if it did, change that status in the database, if not - check again in 15min and so on.

7. The page which will show the data in the database should be a simple page with a table that is sort-able, showing the emails with the "pending" status first, and there should be a pagination system which will make sure to show only 15 emails per page, so it will load fast, also there should be an option to search for the data in this table via 1 general search.

This is it, The person to do this task has to have an experience in web crawling, and can create this simple system within a few single days.

We are looking to pay no more than 100$ for this project. Please bid only if you are able to do this project now within this price range.

Thanks in advance!

HTML5 JavaScript MySQL PHP 网页搜罗

项目ID: #9743124

关于项目

17个方案 远程项目 活跃的Mar 1, 2016

授予:

anmok

I can write node.js app for solving this task. It will no require cronjob. I understand a most things you want to get except of status. Is script should detect status using the extracted link? Should a script page use 更多

$111 USD 在3天内
(5条评论)
3.3

有17名威客正在参与此工作的竞标,均价$184/小时

mistersoft

Hello! I am expert PHP/MySQL programmer with over 10 years experience with different API. I can write this script for you very quick and with best quality.

$200 USD 在3天内
(480条评论)
7.9
mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$325 USD 在6天内
(319条评论)
7.4
techwelfare

Dear Sir we are capable of performing the required task perfectly with accuracy, please let us know if you want to clarify in details.. if you want us to share our skill and previous work please initiate the chat b 更多

$222 USD 在9天内
(152条评论)
7.0
ferozstk

Hello, Thank you very much for this Web Scraping Project. I read through the job details extremely carefully and understand your required, for this I am absolutely sure that I can do the project very well. I can compl 更多

$155 USD 在3天内
(92条评论)
6.4
Verz1Lka

Hello! I'm web scraping expert. I use python language and scrapy framework. My scripts works on windows, mac or linux, but linux is preferably. I can schedule scripts on server if it is required. I have more 200 fi 更多

$200 USD 在10天内
(105条评论)
6.5
WebDeveloperBR

Hi, I can do it.. already made a few scripts with IMAP and Gmail before.. I'm a web scraper expert (please check my reviews: 5 stars with 100% completion rate).. I have computer science degree + specialization in we 更多

$200 USD 在5天内
(24条评论)
5.5
RajakScripts

Hi, I can help you to do that, below are my responds/questions: #4.1 Is it a fix/constant label? Or, is there a convention/rule to provide the label (please inform)? #4.2 I assume the line you mean is a new 更多

$100 USD 在4天内
(39条评论)
5.2
mervf

I have read over your project description and I'm interested in completing your task. If you check my site or portfolio you will see that I am of a higher quality than most freelancers on here. I get it done quickly, e 更多

$216 USD 在3天内
(20条评论)
4.0
sayli2

Hello, I can write web crawler for gmail with your mentioned features. --- Thanks Warm Regards Sayli

$300 USD 在7天内
(9条评论)
2.9
ravivadadoriya

I have read ur description and can able to do this

$100 USD 在6天内
(0条评论)
0.0
namitmahuvakar

A proposal has not yet been provided

$222 USD 在40天内
(0条评论)
0.0