Find Jobs
Hire Freelancers

Write a program to auto catch data from a site.

$250-750 USD

已完成
已发布超过 7 年前

$250-750 USD

货到付款
Hi there. I need someone to write a program that can auto catch data from this site : [login to view URL] The program is what I [login to view URL] the data. Look at the category list in the right site first. I need the program can auto catch some categories' data. Some of them are under [恋愛・少女漫画], from [ちはやふる] to [すきっていいなよ。]. Rest fo them are under [ファンタジー漫画], from [終りのセラフ] to [クレイモア]. *Check the attachment named “category” You have to output data in the following way: Data Structure: id----order url----URL of the article cat----category title----title magazine----magazine author----author genre----genre character----character site----goal website article----the text entry_data_at----publish time created_at----catch time picture----the cover the article *Check check the attachment named “tip1,tip2,tip3” Explanation: [cat],means the name of [login to view URL] the category list in the right [login to view URL] can see words like [ちはやふる] and [黒崎くんの言いなりになんてならない],they are categorise. [title],check the category [ちはやふる],turns to a new page,you can see words such as [ちはやふる33巻173首のネタバレ感想] or [ちはやふる33巻172首のネタバレ感想], they are titles. [article],check one title like [ちはやふる33巻173首のネタバレ感想],turns to a new page,you can see an article with lot of [login to view URL] have to catch the body which from the title(ちはやふる33巻173首のネタバレ感想) to the end of the article (end at the place above [目次][コメント] and advertisements). [entry_data_at],means the publish time of the articel,for example,the publish time of ちはやふる33巻173首のネタバレ感想 is the one written under the title - 2016/10/[login to view URL] have to record it by using timestamp,which would turn 2016/10/01 into 1451577600. [url],means the url of the article,like [login to view URL] [site],all write as [login to view URL] [character],for example, [login to view URL], under advertisements,there is a [目次] [login to view URL] can see [33巻173首] write in black and has no [login to view URL]'s the [character] About [author],[magazine],[genre],[picutre],[id] and [created_at],you should do the following step first. Search [cat] in [login to view URL],use the first result. For example,search [ちはやふる] in [login to view URL],you can get: 作家:末次由紀 雑誌・レーベル: BE・LOVE ジャンル: スポーツ / 少女マンガ / アニメ化 / 映画化 So, [author],means the words after [作家:]. In the example the [author] is [末次由紀]. [magazine],means the words after [雑誌・レーベル:], In the example the [magazine] is [BE・LOVE]. [genre],means the words after [genre:],need to use "," to separate them. In the example the [genre] is [スポーツ,少女マンガ,アニメ化,映画化]. [pitucre],the cover of the first [login to view URL] have to catch covers and store [login to view URL] the datebase there should add a data bar of [pictuer] and have url of each cover. [id],means the order, the first one is 1, the second one is 2, etc. [created_at],means the time you catch the article,also have to record by using timestamp. For example,if I catch the date on UTC/GMT+08:00 2016/10/11 14:40:30, so the [created_at] should be 1476168030. Use [ちはやふる] as the example, do what I said,you can get: id:1 url:[login to view URL] cat:ちはやふる title:ちはやふる33巻173首のネタバレ感想 magazine:BE・LOVE author:末次由紀 genre:スポーツ,少女マンガ,アニメ化,映画化 character:33巻173首 site:[login to view URL] article:<h1 class="entry-title">.......... picture: <..>. entry_data_at:1451577600 created_at:1476168030 *Check the explanation named “database sample”. This is what I [login to view URL] have to make the program to catch data in this way to make my server can recognize the data. Need to catch data 2 hours one [login to view URL] to send me the program you write to catch data. Because all I need is a [login to view URL] the budget is 300 USD. Tap 113114 in your bid.
项目 ID: 11783965

关于此项目

10提案
远程项目
活跃7 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
颁发给:
用户头像
First of all I know about "113114". I'm expert in web scraping with HUNDREDS of completed projects and excellent reviews that's why I'm sure you'll be impressed with my work. I can create such scraping program for you in 2-3 days and I can offer you best price here. You have pretty good project description so all I need to start is milestone payment from you. You'll release it only after you check everything on your side. Thanks. Roman
$294 USD 在3天之内
5.0 (379条评论)
7.1
7.1
10威客以平均价$341 USD来参与此工作竞价
用户头像
Hello, I am able to create the scraper. The first time, the scraper will need to get all the articles on the site and the associated data from cmoa.jp. Then in the future, will it just need to get new data?
$300 USD 在7天之内
5.0 (335条评论)
7.3
7.3
用户头像
A proposal has not yet been provided
$250 USD 在3天之内
4.9 (186条评论)
7.0
7.0
用户头像
113114 =========================================================================== Hi, I am interested in your project and would like to offer you my service for this project. I have already worked on similar projects where i my task was to develop desktop applications for scrapping the data from sites. Please have a look at them, 1. https://www.freelancer.com/projects/php/Grab-public-Facebook-data/ 2. https://www.freelancer.com/projects/Scrap-classified-website/ 3. https://www.freelancer.com/projects/Java-C-Sharp-Programming/Scraper/ 4. https://www.freelancer.com/projects/C-Sharp-Programming-NET/Scrapping-websites/ Regards, Shafeeq
$333 USD 在7天之内
5.0 (23条评论)
6.1
6.1
用户头像
Hi I have read your job description extremely carefully , so now don’t need to worry we will give PROFESSIONAL work in MINIMUM PRICE and I am absolutely sure that our team can do the job very well but I have couple of questions in my mind regarding your project. For more discussion regarding this project please ping me on chat box . I will be explain my strategy DISCOUNT OFFER- FREE Domain with FREE Hosting We have a Expertise team of more than 120 people : We have a Expertise team in following Technology Stack- Technologies stack- • PHP, .NET , JAVA, C • CMS & Ecommerce - Magento, Wordpress, Drupal, Joomla, Opencart,Prestashop • PSD,HTML5, CCS3, BootStrap ,Java Script • PhoneGap, Cordova ( For hybrid Mobile App) • • Android (For Native Mobile App) ,IOS Application & Windows application Development • AngularJS, BackboneJS • NodeJS • ChartJS, D3.js, • NoSQL Data Base, MongoDB, My Sql • Google Adwords /SEO/SMM experts Regards Jack
$555 USD 在10天之内
5.0 (21条评论)
6.0
6.0
用户头像
113114 Nice to meet you. I see you know Timestamp, I guess you are also a developer yourself? because other people don't use such format time usually. Then do you care about the programming language? The frameworks used? etc I can create scrapers with C#, I use Selenium or HtmlAgilityPack to parse HTML code. Before request the job, I view the HTML code of an article, and found that the content is static HTML code, not generated by JS dynamically. This will make the process easier. I can start now.
$300 USD 在7天之内
5.0 (9条评论)
4.1
4.1
用户头像
Hello , I am AutoCAD Drafter and Programmer with 7 years of experience in designing and developing applications for AutoCAD using Autodesk API's. Great experience on AutoLISP & Visual LISP Programming and custom application development for AutoCAD. I have been working on the different domain of drawings like Electrical Design/Drafting, Architectural, Civil, Survey, Mechanical, Contour Maps and Drainage System. Most of my projects were created in AutoCAD and SketchUp with rendering in Vray. I can also work in AutoCAD, Revit, 3ds max and Photoshop. Experience:- AutoCAD/CAM/CAE , Google SketchUp , Photoshop. List of My AutoLISP Programs:- 1. Import and Export data 2 .Import and Export Attribute blocks 3. Plot data with different colours (Create Gradient Image) 4. Generate Contours for data 5. Create Grid for Mapping 6. Incremental Attribute Suite 7. Anchor Pattern tool 9. RCC Design Tool (Railway Standard) I have Joined Upwork as my full-time Professional . My client's satisfaction is my dedication. My goal is to offer my clients the best e-solutions. I Guarantee to provide you best work with your full satisfaction. Please give me one chance for show my quality. Thanks
$273 USD 在10天之内
5.0 (7条评论)
2.0
2.0
用户头像
I have over 10 years of experience in e-commerce websites in software and e-commerce development I have done website grabbing for different companies from world leading food portal and world number 1 ecommerce website for their business. I am from India, this is my first bid on freelancer.com.. if you are not satisfied with my work.. will refund you full amount...
$333 USD 在5天之内
0.0 (0条评论)
0.0
0.0
用户头像
I can do the work and deliver the program to you in the given time regards srinivad
$444 USD 在8天之内
0.0 (0条评论)
0.0
0.0

关于客户

CHINA的国旗
kojima, China
5.0
29
付款方式已验证
会员自5月 5, 2016起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。