Retrieve Product Data From Website
Product Data Crawler / Data Miner / Data Grabber
I need to obtain all of the products data (pictures, descriptions, etc) from the Lighting website called: www dot lighting universe dot com
Please read through this entire post before you bid. Please only bid if you have experience with this type of project & are confident that you can complete it.
~~!! IMPORTANT !!~~ ~~!! IMPORTANT !!~~ ~~!! IMPORTANT !!~~ ~~!! IMPORTANT !!~~
This project is for the ACTUAL FINISHED PRODUCT DATA - NOT FOR THE SOFTWARE (crawler/miner) which you create to retrieve the data.
I will obtain the data from you in one of two ways;
1) Either download the finished database from whatever server you use for this, or
2) Pay to have the data shipped to me on DVD’s.
The data should include all of the product information found on the product pages.
Such as:
»»» Product Name
»»» Large Image
»»» Manufacturer Name
»»» Product ID (it is the number located in the title)
»»» List Price
»»» Price
»»»Product Options -including images & names from drop down menu for example:
[login to view URL]
[login to view URL] or
[login to view URL]
[login to view URL]
(this is only found on some items)*¹
»»»Product Details
»»» Product Description
»»»Additional Details
»»»Style (this is not found on the product page itself, rather it is an attribute of the products themselves and is the last part of the breadcrumbs)*²
Notes:
*¹At first glance this looks very daunting since one product seems like it has over 100 combinations. But this link for the “New Country French Nine Light Chandelier” (sku=14024) is unique and 90% of the products do not contain additional options. I gave an extreme example to minimize the complications. The different options seems to be the biggest challenge of this job, while some of the options may increase the products’ price, and they all have different part numbers, they are not actually listed as separate products within the website. When I receive the data I will need to be able to organize it in this manner – the options will be matched up with the proper image options, & where relevant; additional costs. If you add the product to your shopping cart (on the lighting universe site) with different options you will notice how the product ID reflects differently for each option (this means there are in fact different products for different options)
*² For the “Styles” see the sub-category listing for Chandeliers here: [login to view URL] [login to view URL]
You will notice the “narrow your results” by “Style” on the left hand menu, the other “narrow your results” options are based on database fields taken from the product information as listed above.
There are approximately 70,000 products located in 44 subcategories under five main categories.
The products that we want are located within subcategories found at the following URLs:
(Remove the space after the word “lighting below to use the URL)
[login to view URL] [login to view URL]
[login to view URL] [login to view URL]
[login to view URL] [login to view URL]
[login to view URL] [login to view URL]
[login to view URL] [login to view URL]
PS I am putting another post on GAF for manual product data entry. Please do not bid on both projects.
Hi
We are experienced WEB Crawler programmer. and have resources and experiences to work out your data the soonest, the completest and the cleanest. Pls see PM for more information
I have more than 9 years Experience in WEB DEVELOPMENT,SOFTWARE DEVELOPMENT and SEARCH ENGINE OPTIMIZATION. I can Provide you the solution. I will start ASAP
We have been doing this job for almost one and a half year now. We have extracted information from almost 400 odd sites as yet. Please see PM for further detail.
With many years experience in web design and management, E-Commerce and multimedia, Swastik InfoTech is able to provide you with custom-made solutions to suit your business requirements. Using the latest web development programs and graphics applications, we are able to produce fast loading, dynamic sites that are easy to browse. In addition, we can provide domain registration and hosting packages, website maintenance, search engine optimization and web positioning services to maximize search engine visibility.
Ø Professional Web Site Design
Ø Custom Web Design Solutions
Ø Custom Web Programming
Ø PHP Programming
Ø E-commerce Web Site Design/Programming
Ø PHP & MySQL Database Integration
Ø Database Driven Web Sites
Ø Affordable Web Design Packages
I have a bot software which can get the required information from any website. you use this to get product info from any website perodically or if want to do it only once, it is also possible