Scrape one coupon site and one retailer website and store data in mysql (Send me message for details).
Following are the requirements:
- Use Python Django
- Use Proxy (Use proxy library that is frequently refreshed or scrape and store proxy frequently)
- Use (Scrapy Cluster) for Job distribution, concurrent processing
- Use Celery or something similar with a simple user interface in PHP to schedule and monitor jobs
Backend - Mysql (Models will be provided for retailer, coupons)
7 威客就此工作平均出价 $134
I've been creating scrapers for years. Its been a big part of my career. I'd love to be part of this project, and help you out. Send me a message. I look forward to hearing from you.
Hello! I am a python developer. I looked at your project and it seems interesting. I have all necessary skills required for this project. Ping me to discuss in detail.