Python web scraper using ec2 and S3. Files rewritten by a text rewriter api.

已完成 已发布的 7 个月前 货到付款
已完成 货到付款

Create a python scraper that scrapes web pages, stores scraped files on S3 as text. The files are then rewritten by a rewriter api tool.

key steps are:

- Scrape links based on keywords, dates and number of requested articles from specfic websites

- Create the a source list of urls on a text file from this

- From this source list of urls on the text file extract the text contents of the web pages and output in text format

- Write these source articles to an S3 bucket folder

Once all article are retrieved

- run article through an text rewriter api

- place rewritten articles into a different S3 bucket and folder.

The article text file will have in its content

* The article url

* content of the article

The rewritten article text file will have just

* rewritten content of the article

The format of rewriting article should be

s3/folder/[login to view URL]

eg. s3/20230912/[login to view URL]

Required implementation tools:

Use a scraping api such as [login to view URL] to act as a proxy to grab links and articles.

Use an article paraphrase api such as [login to view URL] to rewrite articles.

These have free trial or low cost options for development

You need expertise in:

Python

EC2

S3

IAM

Linux

You will use your AWS account for development

On conclusion of the project you will supply:

1. Python code for the solution

2. Documentation describing how to implement the solution

3. Demonstration of code working

4. Assist with any implementation issues

Python 网页搜罗 Amazon S3 Linux Amazon Web Services

项目ID: #37230224

关于项目

58个方案 远程项目 活跃的7 个月前

授予:

serazummunirz

Hi There, I am capable of doing the above-mentioned job effectively and efficiently without any hassle. I have the required expertise and have worked on very similar projects in the past. I am confident that I am the 更多

£200 GBP 在1天内
(71条评论)
6.1

有58名威客正在参与此工作的竞标,均价£170/小时

chirgeo

Hi! I'm George, a web crawling expert with proven experience in scraping, rewriting and extracting data from web pages using Python, EC2 and S3. Having created a custom web scrapper myself, I'm confident that I can bu 更多

£408 GBP 在3天内
(155条评论)
8.1
sonus21

Hello Obs! I hope you're well. I'm a senior Scraper developer with experience in developing scraper using scrappy and headless browsers. I can deal with bypassing IP throttling limit, ban and captcha solve, storing the 更多

£250 GBP 在14天内
(55条评论)
6.2
anayapallavi

I can make web scrapper as per your requirement. Please initiate a message for further discussion.

£100 GBP 在4天内
(17条评论)
5.3
QASIM7862001

I can make you a smart system which will perform the described task in 48 hrs Hey there, i am developer from the UK with over 9 years experience in web development. Upon reading your project description this seems lik 更多

£500GBP 在1天里
(14条评论)
5.4
akhilvl1302

"Hi, I am an expert in Python, AWS and scraping. Can create features based on your requirement Skills: NodeJs, Python, PHP Please message me for further discussion. Thanks!"

£225 GBP 在7天内
(74条评论)
5.8
prdraco

Feel free to contact me for Python web scraper using ec2 and S3. Files rewritten by a text rewriter api .shoot me message to discuss further more details .i provide the comments,images,videos,demos and live sessions i 更多

£150 GBP 在7天内
(17条评论)
5.6
techplusintl

Hi there, ★★★ Scrapping / Python / Selenium Expert ★★★ 10+ Years of Experience ★★★ I've read requirements and ready to scrape web pages, stores scraped files on S3 as text. Some major works we do: ✔️ Product Websites 更多

£250 GBP 在2天内
(32条评论)
6.1
carina0530

Hello, ✵✬✭✮ As senior scraper developer, I can complete your project perfectly!✵✬✭✮⚝ I have much experiences in EC2 field.(i have installed nodejs and python on ec2) I can get this done at short time, because i have a 更多

£135 GBP 在7天内
(19条评论)
5.1
shrec

Dear, hello. I've rich 7+ years of experience in Python Web scraping and AWS, I have an AWS account, I just finished a job that was like that. I am certain that I can complete your project exactly as you require it b 更多

£135 GBP 在7天内
(6条评论)
5.1
merinsinha

Python expert. I can do it. As 9+ years experiences in these field. I can give good quality work. I have read the guidelines of your work.I believe that i can provide you the best quality works you are anticipating fro 更多

£155 GBP 在3天内
(54条评论)
5.6
Techalchemy

Hi Sir, As a highly skilled and experienced, I am confident that I can provide the high-quality work you need, but i have some doubts regarding the same, lets discuss in detail make it clear & then i am ready to start 更多

£135 GBP 在7天内
(15条评论)
4.8
prateekhighskyit

I understand that you are looking for a Python web scraper that scrapes web pages, stores scraped files on S3 as text, and then rewrites the files using an article paraphrase API tool. I am confident that I can help y 更多

£135 GBP 在7天内
(3条评论)
4.5
NadMax

Hi. Experienced Python Developer here with 8+ years of hands-on experience. I can assist you in creating a Python scraper for web pages, storing scraped files on S3, and implementing a text rewriting API. To proceed f 更多

£135 GBP 在7天内
(3条评论)
4.7
dataspro

Nice to talk you Haktermast, After reading in detail the requirements of your project and concluding that they match my areas of knowledge and skills, I would like to introduce myself. My name is Anthony Muñoz and I 更多

£380 GBP 在7天内
(4条评论)
4.1
AmazingEngr76386

I understand that you are looking for someone to create a Python web scraper that scrapes web pages, stores scraped files on S3 as text, and then rewrites these articles using an article paraphrase api tool. With my ex 更多

£200 GBP 在7天内
(10条评论)
5.8
soramaru

Hello As a Python expert with 5 years of experience, I have mastered Python frameworks such as Django and Flask. I am familiar with building SaaS, booking, ecommerce, ERP/CRM, and backend(admin panel) using REST API. 更多

£120 GBP 在3天内
(2条评论)
4.0
Dhawan8787

Hi sir. I'm excited about your project and confident in my ability to deliver your project . I'm committed to exceeding your expectations and ready to start from right away . Let's connect and discuss the next steps! T 更多

£135 GBP 在7天内
(7条评论)
3.7
Demenntor

Dear Client, I am writing to express my interest in your project to create a Python web scraper that scrapes web pages, stores scraped files on Amazon S3, and utilizes a text rewriter API to rewrite articles. With my 更多

£220 GBP 在7天内
(17条评论)
3.7
MohmedAbdelwahab

Hello there, I am mohamed and I am a highly experienced Python developer with extensive experience in machine learning, AWS, and data scraping technologies. With a deep understanding of Python programming, I have devel 更多

£135 GBP 在7天内
(7条评论)
3.4
Rubi64420

Hello, I possess the skills and proficiency to perform the job mentioned above with ease and efficiency. I have the necessary expertise and a track record of successfully handling projects of a similar nature. I have 更多

£300 GBP 在4天内
(2条评论)
3.1