Remove duplicates in spark-streaming producer to kafka

$30-250 USD

已完成

已发布

将近 5 年前

$30-250 USD

货到付款

spark streaming application publishing duplicate messages to kafka topic . Need to eliminate duplicates publishing to kafka Spark version - 2.2 Kafka version - 0.11 Scala 2.11.8

Scala

Spark

项目 ID: 19946955

关于此项目

2提案

远程项目

活跃5 年前

想赚点钱吗？

电子邮箱地址

在Freelancer上竞价的好处

设定您的预算和时间范围

为您的工作获得报酬

简要概述您的提案

免费注册和竞标工作

颁发给：

@gayatrigupta34

I am a big data Developer and i have good expertise in Spark streaming with kafka and language used as scala. please give me a chance to serve you better with my skills.

$277 USD 在6天之内

5.0

(2条评论)

1.1

2威客以平均价$277 USD来参与此工作竞价

@dineshrajputit

Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like springboot, angular, node, PHP, Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks

$277 USD 在5天之内