Hi,
Can you make PHP Java web scraper/crawler for any website by putting a code into PHP file?
Normally, I put a simple htmldom to my PHP file as following:
<?php
function getDetail($ASIN){
$returndata="";
$contents=curlContent($ASIN);
$html = new simple_html_dom();
$pageURL="http://".$_SERVER['HTTP_HOST'].$_SERVER['REQUEST_URI'];
if(!empty($contents))
{
$html->load($contents);
if($html->find('div[class="product-details-and-care"] ul')){
foreach($html->find('div[class="product-details-and-care"] ul') as $detail){
$returndata=$detail->plaintext;
$regex = '#<img([^>]*) src="([^"/]*/?[^".]*\.[^"]*)"([^>]*)>((?!</a>))#';
$regex = '#<a([^>]*) href="([^"/]*/?[^".]*\.[^"]*)"([^>]*)>((?!</a>))#';
$returndata = preg_replace($regex,'',$returndata);
}
}
else {echo "There is currently no description for this product. We do not represent or warrant that product descriptions or other Content on this Site is accurate, complete, reliable, current, or error-free.";}
$html->clear();
unset($html);
}
return $returndata;
}
echo getDetail($ASIN);
?>
$ASIN is a page url variable of any web page and this case I using with any product page of [login to view URL] such as [login to view URL]
A function will find element UL under div class of product-details-and-care and will print data as plaintext when visiting a page and connect with $ASIN, if not found or can't access page will print custom text as 'There is currently no description...'
However, I got a problem when currently this code seems to be old-fashioned or get restricted to access and print data on my webpage.
So, I want to know can you make or develop a code with other language in java or etc to working with my PHP file to let all websites allow me to crawl and scrape their content to displayed on my webpage?
Thank
yes, let's clarify the requirement in details
also if you want us to share our skill and previous work let us know..
hope to hear you soon..
Thanks & Regards
RIMSHA
Hi, I have gone through your requirement and I'm very interested in this job. Yes I already did this type of jobs and its more easier for me to do this job. You can also check my profile's reviews and ratings about my quality of the job. If you need to do any SAMPLES, please let me know. I'm ready to do the Sample
Hi there,
thanks for the project. Please tell me if you want me to send you the demo app? You do not have any obligation about it .
I like to make similar bots, I find your idea very challenging.
Thanks,
MrScraper
Astute is having dedicated testing team with expertise on PHP programming.
1. We have Managed and maintained development of PHP backend for dynamic database driven websites
2. Provided technical support in the assurance of quality systems and system changes
3. Designed,coded ,developed, debugged and tested system specifications for conversion and development projects
4. Met regularly with clients to discuss system requirements
5. Reviewed programming projects and reported statuses to programming managers