作为一名企业主，我不断寻找方法来简化我的运营流程。我需要一位经验丰富的网络抓取和自动化专家开发一个工具，以协助完成以下任务： 从1688抓取产品详情：理想的工具应该能够抓取产品详情，如定价、描述和图片。 自动填充购物车：工具应该能够根据关键词或特定的产品ID高效地自动填充我的1688购物车。这种灵活性将允许我根据决定如何采购我的产品迅速行动。 结账：一旦产品加入购物车，系统应该继续进行结账。这将为我节省宝贵的时间，并大大减少我购买过程中涉及的操作步骤。 了解1688平台、精通网络抓取和自动化编程是这个项目的关键。 所需技能包括： PHP JavaScript Python 网络抓取 React.js框架
您好，BEST WEB-IT Translations。我留意到了你的简历，想让您参与我的项目。我们可以讨论一下项目的细节。
您好，BEST WEB-IT Translations。我留意到了你的简历，想让您参与我的项目。我们可以讨论一下项目的细节。
您好，BEST WEB-IT Translations。我留意到了你的简历，想让您参与我的项目。我们可以讨论一下项目的细节。
您好，BEST WEB-IT Translations。我留意到了你的简历，想让您参与我的项目。我们可以讨论一下项目的细节。
您好，BEST WEB-IT Translations。我留意到了你的简历，想让您参与我的项目。我们可以讨论一下项目的细节。
我需要有人帮忙从一些网站上复制一些信息。
你好✓ Best Web/Mob Developers，我注意到你的个人资料并想把我的项目给你。我们可以通过交流来讨论任何细节。
I have a web scraper script that needs fixing. It's designed to scrape various URLs from the Apollo website. Key Requirements: - Scraper debugging: The script is currently not working properly, and needs to be fixed. - URL scraping: The script should be able to successfully pull the data from the selected URLs on Apollo website. Experience with: - Web Scraping: Previous experience in web scraping is essential, as the data needs to be pulled accurately from this specific website. - Script Debugging: Ability to identify and fix issues within an existing script. - Proficiency in Python or relevant language for web scraping. - Knowledge of Apollo website structure. Please make sure your bid includes information on how ...
I'm seeking an experienced data extraction specialist to scrape both HTML and text files for specific data. Particulars to look for will involve the text content within these files that follows a mixed format structure so would require vast knowledge and understanding of both table format data and paragraph-style data. Key Skills and Experience Required: - Strong abilities in web scraping - Adept with HTML, text parsing - Knowledge of data formats and how to transform data - Proficient in CSV file generation. We need a comprehensive extraction that maintains the integrity and accuracy of the data. As these files do come in multiple formats, versatility and attention to detail are paramount on this project.
...skilled and experienced Data Scraping Specialist to optimize and significantly increase the speed of our current data scraping processes. The ideal candidate will have extensive experience in web scraping, advanced knowledge of bypassing anti-scraping measures, and proficiency in utilizing cloud-based solutions for enhanced performance. Strong problem-solving and hacking skills to navigate complex web security systems are essential for this role. Responsibilities: Analyze and improve existing data scraping scripts to maximize efficiency and speed. Implement and manage cloud-based solutions (AWS, GCP, Azure, etc.) for scalable scraping tasks. Develop advanced strategies to bypass anti-scraping measures ...
I'm looking for a skilled freelancer with prior experience in data scraping to help me extract specific text content and URLs from a public site. Key Details: - Your main task will be to collect the text content and URLs from the site. - Previous experience in a similar project is a must. - Please provide me with details regarding your experience in your application. The purpose of this data scraping project is for market analysis.
I am in need of a research professional to conduct an in-depth study into nursery and early child learning centers. Specific areas of focus should include: - Curriculu...of a research professional to conduct an in-depth study into nursery and early child learning centers. Specific areas of focus should include: - Curriculum and teaching methods for children aged 2 to 4 years. - Parent involvement and communication strategies used in these settings. The purpose of this research is to identify current best practices in these areas. Given this, the ideal candidate will have experience in education research, specifically within early childhood settings. Knowledge in curriculum design, early childhood development, and parent-teacher engagement strategies are a crucial requireme...
I'm looking for a data scraping specialist proficient in leveraging social media platforms, business directories and website scraping. The goal is to create an Excel sheet with approximately 500 entries for market research purposes. Skills & Requirements: - Proficient in data scraping from multiple sources - Capable of filtering and sorting data - Able to extract and compile the following data fields: zip codes, locations, contact information, business name and industry. The successful candidate should demonstrate experience in similar projects, showcasing their ability to find and compile information efficiently and accurately for market research purposes.
I'm looking for an experienced developer to create a Flag Status Alert app for both iOS and Android. The app will notify users when to fly the flag at full or half-staff based on their state. The information could be obtained from all 50 state and territory governor pages and the White House website or through a manually updated database. Key Features: - Development for both iOS and Android platforms - Implementation of user notification features including push notifications, email alerts, and SMS alerts. Ideal Skills and Experience: - Proven track record in developing and launching user-friendly mobile applications for both iOS and Android - Familiarity with APIs and web scraping to acquire real-time data from government websites or the abi...
I need a comprehensive web scraping task done on Yellowpages for business broker. The goal is to extract the following data about businesses: - Business name - Address - Phone number - Email - Website - Contact Person I'm looking for a professional who is well-versed in web scraping and can deliver accurate and complete data. Skills required: - Proficiency in web scraping techniques - Experience with scraping - Attention to detail to ensure all relevant data is captured - Ability to deliver in a timely manner Please note that the number of pages to be scraped is not defined, meaning the task might involve a large number of results. The scraper should be able to handle this efficiently.
...assist: - **Scraping from Multiple Platforms**: I need you to scrape email addresses, phone numbers, and any available social media accounts of these companies. You'll need to do this across Yelp, Google Maps, and TripAdvisor. - **Social Media Scraping**: In addition to the primary two platforms (Instagram and Twitter), I'll also need you to scrape Facebook accounts if available. Ideal candidates for this project should have: - **Web Scraping Experience**: A good knowledge of web scraping techniques and tools, which will ensure you can obtain accurate and reliable data. - **Data Mining Knowledge**: The ability to identify and extract the necessary data points efficiently. - **Familiarity with Social Media Platforms**: Knowled...
I'm looking for a freelancer to help me extract financial data and regulatory filings from a tax website. This involves scrapping website using the provided credentials by the client, i am looking for getting the python code as i can run the code myself in the future or integrate it to another system. Key Requirements: - I need approximately 300 data points extracted. - The output for these data points should be organized into a PDF or Word. This project is about creating an automated system to generate instant reports about a company. Only difficulty is the website has drops downs to select the period involved and in those 300 data points actually many come from the same source. Ideal Skills and Experience: - Experience in web scraping (Python) ...
we have a rds ec2 server running and we are looking for a person who can do some adjustment to it.
I need a freelancer with web scraping skills who can extract product prices and models from my 17 competitors. Ideally, the freelancer should be able to: Extract information accurately and comprehensively. Upload all the extracted information into an Excel sheet. Create a simple online website to facilitate this process. I have hosting and a domain. Enable me to update the extracted information with a single click. Complete this task within a maximum of 48 hours. Please include detailed proposals in your application on how you would approach this project.
...python3 programmer to create a sensor-data generator for the website www.voeazul.com.br. The objective is to send a POST request to the site with valid sensor-data in order to obtain a particular cookie (_abck) for data analysis purposes. The sensor data to be simulated includes mouse movements, keyboard interactions, and browser interactions. Key Requirements: - Create a sensor-data generator in Java or python3 - The generator should simulate mouse movements, keyboard interactions, and browser interactions - The sensor-data should be valid enough to trigger the generation of the _abck cookie upon sending a POST request to Ideal Skills and Experience: - Proficiency in Java/python3 programming - Experience in web scraping and automation - Knowledge of coo...
Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put in database
I'm looking for an expert to help configure my Cyclecloud HPC cluster. This is a specific project with the following requirements: - Configuring the cluster for machine learning and simulations tasks - Ensuring the cluster can handle large data processing in a timely manner - Implementing efficient resource utilization strategies - Validating the performance of the cluster with real-world workloads The ideal candidate for this role should have: - Proven experience in configuring Cyclecloud HPC clusters - A strong understanding of machine learning and simulation requirements - The ability to optimize resource utilization and improve scalability - Excellent communication and problem-solving skills read the specs: What I would like to do is to set up a Cyclec...
I'm looking for a freelancer who's great at web scraping to help with a project involving a specific website initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provide sour...
I am considering purchasing Ultimate POS software, but it lacks a crucial feature for managing individual product serial numbers. Although it includes an IMEI/Serial number feature, it only allows you to add the serial number at the point of sale. However, I need to input the serial numbers when updating the stock. For instance, if I purchase 5 units of the GoPro 12 model, I want to update my inventory by entering the serial number for each of the 5 units. This way, I can track which specific serial numbers are currently in stock. Additionally, I need the capability to search for products by their serial number when making a sale. The ideal candidate should have prior experience in customizing POS software, particularly in adding new fields, and should ...
Hi The task is to set up a password protected instance of the OWASP WebGoat running in AWS that is internet facing. To be successful the deployment must be: * Entirely automated using CloudFormation and bash scripts. * The landing page must be a public page protected with a username/password authentication block, this should rely upon CloudFront to perform authentication. The username and password should be configurable in the CloudFormation template. The landing page can be simple HTML that displays the username input, password input and login button. * A user friendly domain name should be configured via Route53 that is configurable in CloudFormation. The domain name can be provided if required. Obviously a AWS TLS1.3 PKI certificate is also required. * Behind the landing page ...
I need a web-based application to calculate the dues per apartment based on the expenses categorized by type. The main points are: - Expense Categorization: The app should categorize the expenses by type. For instance, maintenance, utilities, repairs, etc. - Dues Calculation: - Square Footage Basis: The apartment dues should be calculated based on the square footage of each apartment. - Platform: The application should be web-based, accessible from any browser. Ideal Freelancer: - Experience with web application development, especially in accounting or financial tracking software. - Understanding of expense categorization and calculation based on different parameters. - Familiarity with building user-friendly interfaces.
...transformation and integration. Key Requirements: - Expertise with AWS Glue: You'll be working extensively with AWS Glue, so prior experience with this service is essential. Knowledge of other AWS services like S3, EC2, and Lambda is a plus. - Data Transformation Skills: You will be responsible for transforming raw data into a usable format. Knowledge of best practices in this area is highly desirable. - CI/CD Pipeline Setup: Your assistance in setting up CI/CD pipelines using AWS CodePipeline is crucial for the project's success. Your tasks will include: 1. Utilizing AWS Glue for data transformation and integration. 2. Setting up CI/CD pipelines using AWS CodePipeline. 3. Collaborating with the team on data-related challenges. If you have...
I'm in need of a concert ticket bot that can operate on several platforms, including Ticketmaster, Live ...Technical requirements - use session management and different proxies/ips, implement captcha solving techniques or third-party captcha services if there is any available captcha yet to be solve, ensure scalability to handle high request volumes - Session tracking : the bot should extract and log the link for any session that successfully passes the queue The bot should be smart enough to navigate through the ticketing process of these platforms and complete the purchase. Experience in web scraping, automation, and ticketing bots, as well as knowledge of the mentioned platforms, is a must. If you can build a robust, reliable bot that meets these requirement...
...expert, specializing in web scraping. I require someone who can proficiently extract data from various websites. The specifics of the data may vary from text content, images, links, to contact information. Your key responsibilities will include: - Writing effective and efficient Python scripts to scrape data - Ensuring the data is extracted accurately and in a structured format - Delivering the data in a timely manner The ideal candidate should have: - Proficient experience in Python and web scraping - A strong understanding of data extraction techniques - Proven experience in handling and parsing a variety of data types - Excellent communication skills and the ability to meet deadlines Please be prepared to provide examples of your previous work in ...
I'm looking for an experienced hacker who specializes in database scraping to assist with lead generation. My main aim is to get detailed contacts to grow my business. - Specific Tasks: - Database scraping - Extract contact details - Contact Information: - Email addresses - Phone numbers Ideal candidates should have previous experience in the field. Proficiency in data mining and scraping is a must, along with an understanding of lead generation strategies. Strong grips and successful track records on obtaining accurate contact details are key to perform this job efficiently.
I am in need of an experienced Amazon Web Services (AWS) specialist who has an extensive knowledge in EC2, S3, and Lambda. I represent an AWS Reselling company and am seeking individuals and small to medium-sized firms actively using AWS to partner with us for the 2024 CRP program, which focuses on promoting AWS adoption. Through this program, you can earn rewards for launching new projects on AWS or for your existing active AWS projects. Increase your earnings effortlessly, without any additional workload. If you're interested in learning more, let's connect to discuss the details. Eligibility Criteria: The program is open to all IT companies, independent vendors, and freelancers supporting a diverse range of clients, primarily those in the...
I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly and accurately in real-time. ...
...Extensive experience with AWS, including EC2, S3, RDS, LightSail, Route53 and other AWS services. Proven track record of successfully migrating websites to AWS. Ability to provide clear, actionable advice and best practices for a smooth migration process. Strong communication skills to explain complex concepts in an easy-to-understand manner. Responsibilities: Share your experience and best practices for migrating websites to AWS. Answer any questions we may have regarding the migration process. Guide on optimizing our AWS setup for performance and cost efficiency. Address any potential issues or challenges we might face during the migration. Preferred Experience: Previous experience working with small web agencies or similar business...
I need assistance setting up a WordPress blog on Amazon EC2 for a new blog AWS Setup and Deployment: a new WordPress instance on AWS using Amazon Lightsail or EC2. the existing ThemeForest theme from Bluehost to AWS. Content and Design: the site content is primarily in Arabic, with some pages in English. advice for students on studying abroad. any unnecessary content. a minimalist design. 5. Set up menus, categories, and subcategories. Content Upload: images and articles in Arabic. all content is well-organized and properly formatted. SEO and Analytics: up a Google XML sitemap. Google Analytics. the site for SEO. Performance Optimization: caching solutions to improve site
Introduction We are seeking proposals from experienced web scraping and data analysis firms to conduct a comprehensive data collection and analysis project. The purpose of this project is to gather detailed information on menu items, pricing, customer ratings, promotions, and deals from various food delivery mobile apps operating within our city. The goal is to mine this data for actionable insights to inform our advertising, promotional strategies, and competitive benchmarking. 2. Project Scope The selected vendor will be responsible for developing and implementing a solution to: • Subscribe to and navigate through multiple food delivery mobile apps. • Collect data on menu items including descriptions, pricing, customer ratings, and associated promot...
...are looking for an experienced developer to automate the process of retrieving data from specific websites using CRM and CID numbers. The goal is to develop a script or tool that will: Look up Doctor's Specialization: Use CRM numbers to search on the website: CFM Doctors Search Extract doctor's information including their specialization. Look up Disease Descriptions: Use CID numbers to search on the website: MedicinaNet CID10 Search Extract the disease description. Deliverables: ( ) A script or tool that can take a list of CRM and CID numbers as input. Automate the search process on the specified websites. Extract the required data and compile it into an Excel file with separate sheets for doctors' information
...collecting contact information for recruitment companies specifically operating in Saudi Arabia. Those companies are NOT necessarily based inside Saudi Arabia, could be based anywhere in the world, but they recruit for companies/entities inside Saudi Arabia. Please note that I do not need recruitment people in certain sectors such as Oil, Gas, IT, Engineering, Aviation, Procurement, Transportation, Architecture and Finance. Everyone else is yes needed. Key Requirement: You will need to find the contact name, position, email and LinkedIn account for each and every recruitment/HR/Headhunting person within each company. This could be anywhere between 10 to 30 people per company. - The information should be accurate and up to date. - If you have a strategy for...
I'm looking for a developer to create a Chrome extension that will communicate with a server. The extension should be able to: - Extract the first value from the first document that is loaded - Select the second value from the second document that is loaded The communication between the Chrome extension and the server should be seamless and efficient. The server should be able to receive and process the values extracted by the extension. Iam using a multiple AWS windows instances upto 16. So in every instance I use chrome Browser for my Business to customers daily. So I run a Extension in chrome for Auto click drop-down &radio button That extension developed by other freelancer So Every instance& chrome extension has to connect to the...
I'm looking for a developer to create a Chrome extension that will communicate with a server. The extension should be able to: - Extract the first value from the first document that is loaded - Select the second value from the second document that is loaded The communication between the Chrome extension and the server should be seamless and efficient. The server should be able to receive and process the values extracted by the extension. Iam using a multiple AWS windows instances upto 16. So in every instance I use chrome Browser for my Business to customers daily. So I run a Extension in chrome for Auto click drop-down &radio button That extension developed by other freelancer So Every instance& chrome extension has to connect to the...
I'm looking for an expert to set up Redis in a Rocky Linux podman container. The aim is to ensure that it communicates over TLS using a Let's Encrypt certificate. Key Tasks: - Configure Redis to communicate over TLS - Integrate a Let's Encrypt certificate Ideal Candidate: - Proven experience with Rocky Linux and podman - Strong understanding of TLS and Let's Encrypt - Excellent problem-solving skills The successful candidate will make sure the Redis instance is optimally secured and can communicate over an encrypted channel. I can provide the certificates and build process. podman run --name rediscontainer -it rockylinux:9.3-minimal bash microdnf -y update microdnf -y install redis
...demographics. In this instance, our target audience will consist of individuals aged between 25-34 and 35-44. - Monitor, analyze, and optimize the performance of our advertising campaign to ensure maximum lead generation and sales conversion. Ideal Candidate: - Proven track record of successfully running and managing Meta Ads campaigns, with a strong focus on lead generation and sales. - Proficiency in creating engaging ad content for Facebook and Instagram, with a keen understanding of the nuances that make ads successful on these platforms. - Experience in effectively targeting and reaching specific audience demographics, particularly those aged between 25-34 and 35-44. - Analytical skills to assess campaign performance, identify areas of improvement, and optimize fo...
I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively
I need to Extract followers of group members of the link I will provide
I am looking for a web-scraping expert to retrieve both images and text from a specific website for research purposes. The text data will need to be structured and saved in a CSV file, including paths to saved images. Key details to consider: - Knowledge of web scraping tools and techniques is essential to accomplish this task. - Quality control to ensure accurate data extraction and image quality is critical. - Structure page information and freeform descriptions should be made available in a CSV file. - The images should be saved in their original resolution and quality settings. Please provide any relevant experience you have in web scraping, including free and paid services you have used before to help with your work. I would...
I need a professional who can help me with scraping data API from a specific website or platform. I'm looking to extract specific data points or information and potentially set up a regular scraping process. Key Requirements: - Proficiency in Web Scraping: I need someone who has experience with web scraping tools and techniques. - Data Mining Skills: The ability to identify and extract the specific data points I require is crucial. - Automation Expertise: If you have experience setting up automated scraping processes, that would be a huge advantage.
Project Details Docker and K8s * Containerize any Microservices based app (Frontend and Backend and DB) and run it as a nonroot user. * Write Kubernetes artefa...DB) and run it as a nonroot user. * Write Kubernetes artefacts to deploy above container on K8s. * Setup Database in Kubernetes cluster. * Deploy microservice to Kubernetes cluster. * Ensure that applications are able to communicate with each other. * Only Ul should be Publicly accessible and not the backend. CI-CD * Automated Application Deployment via CICD. * Setup Jenkins in the Ec2 instance created via Terraform. * Create CICD pipeline to automate the actions done in Phase 1 with stages like Build and Push, push the images to Dockerhub, Update the Kubernetes Artifacts with latest image tag and deplo...
...but it's not functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that it's not just supposed to collect all messages or o...
