File Parser to Scan CSV.GZ Files and Calculate Unique IP Addresses

$10-100 USD

已完成

已发布

大约 5 年前

$10-100 USD

货到付款

Problem: I have a large number of [login to view URL] files that each contain csv data. There are about 250 of these files and each one is about 100mb in size (compressed). The CSVs contain lists of IP addresses in column A and I would like to know how many unique IP addresses there are in the files (total, not per file). Solution: I would like a file parser written in python that will scan the [login to view URL] files and tell me how many unique IP addresses exist within the csv data. By this I mean total unique IP addresses amongst ALL the data files, not just the unique IP addresses within each individual file. Thank you for your assistance. Please include a brief description in your PM along with your bid so I can tell that you actually read the project description instead of using an auto-bidder to bid on the project. Just a sentence or two will do.

Software Architecture

项目 ID: 18989668

关于此项目

13提案

远程项目

活跃5 年前

想赚点钱吗？

电子邮箱地址

在Freelancer上竞价的好处

设定您的预算和时间范围

为您的工作获得报酬

简要概述您的提案

免费注册和竞标工作

颁发给：

@osmanaydin

Hello sir, I can parse your files for IP adresses as you like. Please take a look at my reviews and portfolio. I am interested in your project as well. I would like to discuss details via pm. I look forward to hearing from you soon. Best Regards,

$100 USD 在1天之内

5.0

(43条评论)

5.9

13威客以平均价$69 USD来参与此工作竞价

@kaloyan13

A Bash script will be a better/faster option. Will extract each file, append the IPs to a temporary files, then we will unique sort them, using sort -u -k...

$40 USD 在1天之内

4.9

(556条评论)

7.6

@Mickelson

Hi Nice to meet you. I checked your description. I have some similiar script for processing .gz files. I will use numpy library for your project. Just get total unique count is not problem. My question is how you will share those csv files, so I can test properly. Regards Lian

$100 USD 在10天之内

4.9

(119条评论)

6.9

@namitkhandelwal

Its about your project you posted: things can also be done in Java. We can do all the task you mentioned in here. hello, warm greetings! I am a Java developer working on Java technology since 7+ years having hands on windows and web development experience. I would like to help in your application development. It would be better if you can share more details about it if you are interested. Please message me to discuss more about the requirements. Budget is negotiable. looking for your positive response. Thanks Namit

$70 USD 在10天之内

4.9

(81条评论)

5.8

@AhmadSameer

Hey there, I can develop the CSVs parser to count unique IP addresses. I'm a System Engineer with coding skills. I had developed tons of Python scripts. Would you share more details? Regards.

$100 USD 在10天之内

4.7

(29条评论)

5.4

@ukgolang

Hi, I'm not strong on Python, but could write this for you in Golang and compile it for Windows or Linux. I've done work parsing and analysing BGP router views logs, so have I previous experience working with large amounts of IP data. I can read the data from the decompression stream and use a radix tree for optimum speed and minimum memory usage. I should be able to complete this today.

$55 USD 在1天之内

5.0

(6条评论)

4.3

@VnNorthStar

Hi I checked your requirement, I'm sure I can do it well. Gzip library in Python supplies some methods to manipulate with a gzip big file, read all lines from gzip files. Please give me an opportunity. I will do it perfectly.

$30 USD 在5天之内

4.4

(62条评论)

5.1

@jayantavkumar

I am a database / Business intelligence architect and having more than 14 years of experience in IT industry. I can achieve it using SSIS ETL tool. Let me know if you are ok then we can talk further.

$88 USD 在2天之内

5.0

(4条评论)

3.2

@pushpreethanspal

Hey there. Your project looks straightforward. I have done a lot of work with Python and csv files before, and even though I haven't worked with gzipped data, I don't see that being a problem. Even though 100Mb isn't much, I think I'll implement lazy reading so the entire file is not read into memory at once. Let us discuss this further to see if I am the right person for this job.

$100 USD 在7天之内

4.9

(4条评论)

3.4

@skyhaubrich

How's it going? No, this is not an auto-bid. I hope this is enough to prove I've read your project description. I'm Sky, a German Development Enginner with more than 6 years experience in Software Engineering. I would like to write the Python script for you. Python offers a great datastructure that already checks if an entry exists or not. This way, we can determine the unique IP addresses. Best Regards, Sky Haubrich

$35 USD 在0天之内

0.0

(0条评论)

0.0

@Nitin216

Have been working in Python for past one year.. Also contributed to an open source org Symy in past Relevant Skills and Experience Previously worked on Python built Sympy(Open Source) Used Python for ML purpose too.

$61 USD 在10天之内

0.0

(0条评论)

0.0

@ramagni

Hi , Hope you are doing well. Should be able to deliver this project in a day max . I understand the requirement . (ip address-is it ipv4 or ipv6 ). I will be using python as language for implementing this. We can discuss further on this , if required My skype I’d @ live:d311a9e099b4554 Thanks, Ram

$66 USD 在1天之内