Website Scraping Script & Data
$10-30 USD
货到付款
Deliver a script to scrap records & data from website.
The website sells real estate title records. The objective is to retrieve every existing record number available. Basically, determining, if record exists or not.
Issues and limitations:
-------------------------------------------
- UNKNOWN DATA: Requires looped queries to locate existing records.
- SHOPPING CART: Flawed design, where a record is determine to exist, only by being added to shopping cart, otherwise an error is generated.
- UNRELIABLE SITE: Website is prone to crashing, buggy, and may not handle heavy querying.
- DATA CAP: May have a limit on heavy data retrieval.
Data Requirements:
-------------------------------------------
- RETRIEVE ALL RECORDS: Every single record on website (estimated over 200,000 records).
- NO HACKING: Data must be retrieved thru legal and ETHICAL means.
Script Requirements:
-------------------------------------------
- DATA: Perform all Data requirements stated above.
- REUSABILITY: Script should be easily reusable with limited to no human intervention - daily, sometimes multiple times per day.
- SUBSET: Script should accept a small number of variables, such as Date ranges, ID ranges, and whatever is deemed fit, to run a partial scraping. For example: once a full scrap of website is made, we require daily runs, to get the LATEST records ONLY.
项目ID: #16025936
关于项目
授予:
Like discussed, no time waste on it, just next to the other important sites. I will scrape it in the next days/week
有7名威客正在参与此工作的竞标,均价$44/小时
Hello sir, I have experience on web scraping and automations. Will write a python script and deliver with the output. Please check my profile and let me know!