Find Jobs
Hire Freelancers

Pyspark Data engineer for a test project in Spark

₹600-1500 INR

已关闭
已发布大约 3 年前

₹600-1500 INR

货到付款
Looking for a pySpark developer to help with a pyspark application for demonstration purpose. The goal is to read 3 small json files each less than 1 mb into a single data frame. Do preprocessing and then fetch some metrics based on regular expression search. ETL task is easy and I am able to achieve it. However the end goal is written below that is also the acceptability criteria for this project. The developer should be able to write code with following points in mind: Well structured, object-oriented and maintainable code. Unit tests for the different components. Documentation, comments and Proper exception handling. Solution is deployable and we can run it (locally and on a cluster) Config management. (separate folders and files like [login to view URL], [login to view URL] etc. rather than one python script). Logging and alerting. Data quality checks (like input/output dataset validation).
项目 ID: 29872024

关于此项目

1条提案
远程项目
活跃3 年前

想赚点钱吗?

在Freelancer上竞价的好处

设定您的预算和时间范围
为您的工作获得报酬
简要概述您的提案
免费注册和竞标工作
1威客以均价₹1,050 INR来参与此工作竞标
用户头像
Hi, I am working in MNC as Data Engineer and currently working on Big Data Fields using PySpark and Hadoop Frameworks. Having more than 4 years of experience in Big Data Field in production and certified pyspark developer as well as certified Hadoop developer. Requesting you to please share the details. Thanks Rahul.
₹1,050 INR 在7天之内
4.4 (4条评论)
2.2
2.2

关于客户

INDIA的国旗
Pune, India
0.0
0
会员自7月 8, 2019起

客户认证

谢谢!我们已通过电子邮件向您发送了索取免费积分的链接。
发送电子邮件时出现问题。请再试一次。
已注册用户 发布工作总数
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
加载预览
授予地理位置权限。
您的登录会话已过期而且您已经登出,请再次登录。