AWS S3 text files to Relational Database

$30-250 AUD

已完成

已发布

超过 7 年前

$30-250 AUD

货到付款

A little background - I am using AWS to manage a mountain bike timing system. Competitors tag on and off a number of different stages and the tag off time minus the tag on time is the stage racetime and the lowest cumulative time over all stages wins. Out on the racecourse, I am using Raspberry Pi's with RFID readers which collect and store data in text files which automatically upload to the AWS S3 bucket. I currently have two files in there: Stage 1 [login to view URL] and Stage 1 Finish.txt. I need to get these files into a database to join with a competitor registration database so I can ultimately compute racetimes in AWS, extract some analytics and allow competitors to search and compare times using their surname or racing number to find their race times. In short, I need help converting these text files into a relational database and this process is automated so that when new items are appended to the text files that they update the database. I think a Data Pipeline is the way to go but happy to listen to alternative recommendations to achieve my ultimate goals as described above. The text file item/row is semi-colon delimited as follows: [login to view URL];1s;2016/12/30;13:56:23.235;00235689 Meaning log information (not needed), 1s (Stage 1 Start), Date, Time to milliseconds and finally the RFID code. Any help with the Data Pipeline (or another alternative) is required as soon as possible. Thanks Steve

Amazon Web Services

Database Administration

MySQL

项目 ID: 12676953

关于此项目

16提案

远程项目

活跃7 年前

想赚点钱吗？

电子邮箱地址

在Freelancer上竞价的好处

设定您的预算和时间范围

为您的工作获得报酬

简要概述您的提案

免费注册和竞标工作

颁发给：

@jksnetwork

I am highly skilled in the AWS environment. I have been working with AWS for 5 years now and run multiple production workloads across many AWS services. I have both the AWS Devops Engineer and AWS Certified Solutions Architect certifications. I have also passed AWS exams here at Freelancer (in the 99th percentile). I attend the AWS re:Invent conference every year and stay current with their latest services and offerings. If you are serious about finding a real engineer with real-life AWS experience building highly-scalable, fault tolerant applications while following AWS best practices then look no further. I eat, sleep and breathe AWS architecture and work with it every day. I would like to discuss more with you on how exactly the files are uploaded to S3. I can see the upload triggering a Lambda function that would import the data into RDS. Open up a private chat to discuss any specifics. I look forward to hearing from you.

$250 AUD 在3天之内

5.0

(23条评论)

5.1

16威客以平均价$173 AUD来参与此工作竞价

@poornachand

I have 9 years experience in JAVA, J2EE, WebServices and enough experience in AWS webservices. I am not sure if we can dine the pipeline such that it extracts te file and fills the required columns of a relational database. We can use lambda function which can be triggered by S3 action and there we can read the file and process and populate the required relational database.

$166 AUD 在5天之内

4.9

(25条评论)

5.6

@enterpriseit1

Hi, I have over 7 years of experience as a database developer. I have completed three recent projects. All clients were 100% satisfied as you can see from their reviews. One of the projects I completed recently was very similar to yours. The db was hosted on aws. I created the db, created the schema and procedures, installed the schema. This was for the food app. The client was super happy with the work. I can start your project right away and complete in 3 days.

$170 AUD 在3天之内

5.0

(9条评论)

4.2

@DevvTime

Hello there i have read your description, i will recommend a web application for this, can you please contact to discuss in details? i am waiting for your pm thanks

$250 AUD 在3天之内

4.9

(8条评论)

3.7

@bhawin91

I can write a php script which can load data from text file to database. I would love ot work on something new and good thing ..

$155 AUD 在3天之内

5.0

(14条评论)

3.8

@whites11

Hello there. I think lambda could be the solution for you. I can take care of this task if you wish I am an experienced developer with strong aws knowledge

$155 AUD 在3天之内

5.0

(1条评论)

3.7

@explore1

i have similar experience working with S3 and mysql db.

$222 AUD 在4天之内

5.0

(1条评论)

2.6

@ahmad5857

Hi sir, We assure you the quality of service through various checks that are employed to avoid any compromise on quality of work. Let me introduce my team to you and generally what services we offer to our clients. We are team of expert engineers and developers who are sound experienced in embedded systems (arduino + other microcontrollers), programming, circuit designs, electronics, product designs, pcb layouts, database management, MySQL etc. We offer you our services at very low rates. Please discuss with us in details. We will deliver design and code, if you want us to send you prototype, you have to pay additional charges of prototyping and courier such as dhl etc. We are very friendly in nature and help our clients during and after projects completion. We are flexible in communications and rates. Very much looking forward to hear from you on this in coming days. Regards, Ahmed Lead Technical Engineer Turktroniks

$150 AUD 在8天之内

4.2

(1条评论)

3.2

@ebinthomas

Have 4.5 years of experience in Java, REST, Data Structures and Algorithms, SQL and NoSQL(MongoDB, Redis), Spring, Hibernate hence I will be a good help for this project. I had recently worked with Rajhees, C.E.O, MD , Dn Infoway and she had appreciated my work. She is one among the 5 females who have made it big in freelancer. Will continue to work with the same dedication. https://www.freelancer.in/community/freelancing/women-s-day-special-5-freelancers-who-found-success I need some more clarity on the exact requirement.

$155 AUD 在3天之内