Find Jobs
Hire Freelancers

Datascrape and Search Program

$250-750 AUD

已关闭
已发布将近 10 年前

$250-750 AUD

货到付款
Project requires: Datascrape pre-defined URLs, custom search of stored pages, google translate results 1) For a predefined list of URLs (obtain from database, by reference to specific fields in each record); 2) Scrape and store the entire website (text only) ("Level 0 Copy") - avoid duplication/recursion of pages generated from URL-local content databases - time and depth limits to be admin editable and flagged if reached; 3) Search stored Level 0 Copy of each page for certain keywords, keep only those pages for which there is a positive result on search ("Level 1 Copy"); 4) Search remaining Level 1 Copy pages for a separate set of keywords, keep only those pages for which there is a positive result ("Level 2 Copy"); Up to 5 iterations of search and keep only positive results - the structure is of multiple filters, applied sequentially, to produce a small number of remaining pages that match all keyword sets; 5) Final step if keyword searches conducted in non-english languages (defined at beginning of process), send resulting pages (after all 5 filters) to google translate to english; 6) Output - Excel spreadsheet report on search meta-data and results (template will be provided); and pdf of all remaining pages at end of process with translated copy if applicable. This is stage 1 of a larger project and must be completed quickly. Clean coding required due to long-term nature of project. Immediate follow on to next stage. You must advise on any external processing (e.g. cloud) requirements. All testing and development to be on your own account. Final large scale test only to be conducted on my accounts. Your bid must have at least a price estimate, subject to confirmation following discussion and provision of more detailed description of sources and process.
项目 ID: 5929261

关于此项目

16提案
远程项目
活跃10 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
16 freelancers are bidding on average $988 AUD for this job
用户头像
Dear Sir, We are FreeSkyTeam from Hanoi, Vietnam. To meet your requirement, we propose following solutions: 1- We develop a JVM based application using Scala programming language. 2- The app will read list of URL from database you provided and gradually crawl to each web site to parse purely plain text and filter unnecessary HTML tags, CSS, Javascript. 3- We develop several level processing to filter text by keyword and keyword combinations. 4- We write result to CSV that can be imported by Excel. Kind Regards, Cuong,
$1,263 AUD 在50天之内
4.9 (5条评论)
7.2
7.2
用户头像
Hi I can provide a desktop application in C# that will fulfilled the requirements. Ready to provide demo if you are interested. Thanks
$1,157 AUD 在8天之内
5.0 (123条评论)
6.7
6.7
用户头像
Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work. I have too too scraping experience. you can see my experience here: https://www.freelancer.com/u/uumairkhalid.html looking for your reply. Thanks
$526 AUD 在10天之内
5.0 (58条评论)
6.0
6.0
用户头像
Hi, I would like to work on this project. I have done a lot of similar project of this. So willing to response to discuss before awarding this project. Hopefully you will me chance to work on this project. Thanks.
$631 AUD 在10天之内
4.8 (83条评论)
6.0
6.0
用户头像
Hello Sir, We are a well built set up with excellent skilled operator with lot of experience in this segment/skill,have complete more than 200 similar job in freelancer in last 4 years, i have gone through your project description, its really a simple task, we can make a well formatted,error free list. Sir, we are waiting for your reply for communicate also like to make a sample if you allow by a single reply. Thanks DG
$526 AUD 在10天之内
4.8 (62条评论)
6.0
6.0
用户头像
Hi Ashton, I have updated my bid to reflect the new info provided. This will be a very complex scraping process and will involve a lot of trial and error. Personally i think 95% accuracy is not doable , perhaps a 80% would be realistic. In any case i think this is a more realistic budget considering the work involved. What i can promise if my bid is accepted : 1) i'll be your most reliable tested as well as programmer 2) 3 months of support is included (considering the complexity of this project that will probably involve several fixes as certain problems might not be seen until full scrapes are done and analyzed properly over several months. 3) if you look at my reviews i have not let down anyone in the past. With a project like this the biggest concern should be that programmers would simply give up realizing it's beyond their level. Low quality programming at this stage would crush the entire project. What i can promise is that you need someone with my level of commitment to quality. Warm regards, George
$3,000 AUD 在40天之内
5.0 (51条评论)
5.9
5.9
用户头像
Hi, I am an experienced software and Web developer, and I am highly expert at Web scraping. I understand that this is the first stage of a larger project, and I will keep this in mind during development. First things first, what is the primary purpose of this entire project that this first stage is part of? Secondly, are you looking into running this as a Web-based or a desktop application? Respectfully yours, Mark
$560 AUD 在14天之内
4.9 (61条评论)
5.3
5.3
用户头像
I have done 50+ scraping projects with 5 star feedback and should be able to do this one fairly quickly. Please specify the following: - Rough number of URLs you will need to scrap - Rough number of Level 5 documents you expect to get - If you are going to use the paid API of google translate - If you can specify a list of proxies when running the code - If the code can be in python or java
$526 AUD 在10天之内
4.9 (20条评论)
5.0
5.0
用户头像
Hi, I (Myself a senior PHP, ASP.NET programmer using C# and VB) have a team having experience of more than 10 years in developing web and mobile applications. I have a team of expert programmers who write robust and bug-free codes at the very first instance. After seeing our quality of work and the cooperation offered to you even after the work has been delivered to you, you’ll come to us again and again to avail our services. I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. I can achieve the results that you are asking for within your timeframe and budget. I am confident I can exceed your expectations and I would love to work on your project. Thanks, Priyanka
$789 AUD 在20天之内
5.0 (12条评论)
4.9
4.9
用户头像
Good at data scraping and processing.##########################################################################################################################################
$1,052 AUD 在10天之内
5.0 (15条评论)
4.3
4.3
用户头像
Hello, We have excellent team of programmers and designers to work on your project efficiently and complete job in time. We have read your deepest requirement at our best and will surely give better results. thanks
$833 AUD 在20天之内
5.0 (11条评论)
4.2
4.2
用户头像
Hello AshtonRS we can do any type of scarping,hacking and cracking of software contact me......................................................................................................................
$789 AUD 在10天之内
5.0 (1条评论)
3.0
3.0
用户头像
I would like to work on your this project. I'm new in freelancer.com but not know in this sector. I have more than 4 years experience in this sector. So willing to response to discuss about the project. Thanks and god bless you. Sincerely, Saminatinny.
$611 AUD 在10天之内
5.0 (1条评论)
0.0
0.0
用户头像
Hello Sir, Greetings of the day!!! It'll be pleasure to work with you. Allow me to do this task for you. Thanks Bhadresh Skype- bd_orbit
$700 AUD 在20天之内
5.0 (2条评论)
0.0
0.0
用户头像
Hello Sir, We have gone through the details you have provided and we have already worked on a similar project before and can deliver as u have mentioned and would be pleased to work on this with you to deliver the results that you have expected and we have already worked on a similar project before and can deliver as u have mentioned We are sure you will not be disappointed if you give us this opportunity. Our team is experienced, creative & efficient enough to get your job done well. We have an impeccable record and all our clients enjoy working with us, we are sure that you will too, our prices are cheapest in market. can u provide your email or sky-pe etc for further discussion about the project I am ready to discuss with you with best Regards
$555 AUD 在10天之内
0.0 (0条评论)
0.0
0.0
用户头像
I have extensive experience in web-scraping and developing in Java and Python. Most of my projects have been deployed in Amazon Web Services (AWS), but am comfortable with the Microsoft Azure platform as well. I have actually completed a project similar to this several months ago in Java: My project scraped financial articles-- extracting the plain-text, and cataloging them. Since late 2013, the script has run on an Amazon Web Services EC2 instance continuously, cataloging ~1,000,000 articles. If you want, I can provide you with more details about this project. For your project, I would use a similar approach. Using either Java/Python to scrape the page, extract the plain-text, scan for keywords, translate, store, and report. I would deploy via AWS, using an EC2 instance (cost ~$18 USD/month, or, the first whole year is free if you are a new user) + a NoSQL database. Depending on your needs, AWS can be quite inexpensive! I can determine which specific solutions are the best fit after we discuss your project further. Feel free to message me to discuss the project or my experience/capabilities. Regards, William
$875 AUD 在10天之内
0.0 (0条评论)
0.0
0.0

关于客户

AUSTRALIA的国旗
Bolwarra Heights, Australia
5.0
3
付款方式已验证
会员自11月 19, 2012起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。