Web Scraping Jobs

I need a Python script that can promptly search for PDF links containing a user-provided title using dorks on Windows OS. After finding the links, the script should download up to 1000 unique, working PDF files from the list while avoiding duplicates. Key deliverables: - A Python script that operates effectively within the Windows environment - Ability to prompt the user for a title - Dork-based searching for PDF links - Downloading functionality for up to 1000 PDFs - Management of duplicates to ensure the final set is unique

I'm about to get daily PDF forms and need them automatically dumped into a Google Sheets document. The project involves: - Extracting data from incoming PDFs and inputting them into corresponding fields on Google Sheets. - Ensuring that each form submission creates a new row in the Google Sheets document. It's essential that: - The data is accurately extracted with no errors. - The system can handle a normal volume of PDF submissions (no more than 150) Ideal qualifications: - Proficient in web scraping and data entry. - Experienced in working with Google Sheets and PDF manipulation. - Ability to create an automated system for seamless data transfer.

We need a verified database of 200+ Greenhouse Growers growing within large commercial Greenhouses in South Korea. This must include e-mail address, website address and contact info. To be provided within a timeframe of 2 weeks.

I'm seeking a skilled professional to enter 100-500 text entries for me. Key Responsibilities: - Entry of primarily textual data - Handling 100-500 entries Ideal Skills: - Proficient with Microsoft Excel - Excellent attention to detail - Strong typing and data entry skills. Experience in similar projects will be highly appreciated. I look forward to your bids for an efficient data entry task.

I'm in need of a professional who can develop a scraping tool that will track market announcements and releases on a financial website using specific keywords. - The tool should scrape this data on a daily basis. Accuracy and reliability are key. - the scraped data should be filtered for the current date, daily. - I need this table of data to be automatically filtered for keywords. -the filtered results to be emailed automatically to an email list. - the tool to run automatically on a website or server. I'm looking for someone who has a proven track record in web scraping with a focus on financial data. Experience in creating automated scraping tools, particularly those that operate on a daily basis, is a huge plus.

I'm looking to scrape a website using the python package requests. 1) create a session because the site requires a username and pwd login 2) pass an initial URL that will get pagination of results 3) from the results we'll get the URL of the individual person/page we need to get info from 4) we'll make a request call within the session to the persons URL 5) Then we'll parse the HTML from the persons page 6) Then, we'll put the information into a dictionary object and append it to the a list 7) Finally we'll then print out the list of JSON objects to a text file

I'm in need of a Python Developer who is proficient in data analysis, visualization, and data science to work on an array of data types including financial, customer, social media, and pharma data. Key Tasks: - Data Analysis and Visualization: You will be given various sets of data which you will need to efficiently analyze and create meaningful visualizations. - Web Scraping and Automation: Knowledge in this area is desirable but not necessary. - Django Web Development: Again, not a necessity but would be considered a bonus. Objectives: - Efficiency Improvement: Assist in identifying areas of operational efficiency and suggest or implement changes accordingly. - Cost-Saving Opportunities: Use the analyzed data to identify potential areas for reducing costs. - Decision Making Insig...

I'm seeking a freelancer proficient in numeric data entry to handle a personal project. Key Responsibilities: - Enter accurate and up-to-date numeric data provided. Ideal Skills and Experience: - Proficient in data entry, particularly with numeric data. - Keen attention to detail and a commitment to accuracy. - Previous experience working with similar projects would be a considerable advantage. Please ensure you have the appropriate skill set before placing a bid on this project. Your precision and attention to detail will help ensure this project's success.

Looking for someone to install a specific WordPress theme, do some customization for categories, names, UI, and geographies, and then scrape specific data and enter it into the site. This has to be done ASAP

I'm seeking a professional programmer to help me create an effective Twitter bot. The main purpose of this project is to find the most viral tweet from the previous week. Key Features: - The bot should be able to identify the tweet with the highest 'views to followers' ratio. The higher the ratio, the more viral the tweet is considered to be. - It should be able to scrape and analyze tweets from the past week. - The bot should be capable of differentiating between tweets based on their views to followers ratio and identify the 'most viral' one. Ideal Skills & Experience: - Proficient in creating Twitter bots. - Strong understanding of Twitter API and scraping tools. - Familiarity with tweet analytics and calculations. - Ability to extract and process data ef...

I need a web scraping expert to scrape Title, Price, star ratings, delivery window from a specific e-commerce site on a regular basis. - The scraping should cover a range of products, ideally with the ability to specify categories for tracking. - The data needs to be scraped frequently, so automation and scheduling will be crucial. - It's important that the extracted data is accurate and up-to-date as this will be used to inform pricing strategies and customer service. The ideal freelancer for this project should have: - Proficient experience in web scraping, particularly from E-commerce sites. - Proficiency in programming languages like Python or R for automation. - Good understanding of data management and quality control. - Ability to deliver a scraping tool that is user-friendly...

I'm seeking a skilled Python developer proficient in Selenium or other scraping tools, AI and others API integration. The main tasks in this project include: - Integrating APIs: You'll be responsible for seamlessly integrating the following APIs: - Send/reveive data from trained AI - Collect data using scraping - Payment Gateway - Other websites: API to integrate with other websites - Developing B2B Features: We're looking to expand our platform to cater for B2B transactions. Your role will be to create and incorporate features that facilitate B2B interactions. Key skills and experience required: - Proficient in Python - Experienced with Selenium or other scraping tools - Proven track record with API integration - exchange data with AI I'm looking for...

I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.

I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.

I'm looking for a skilled professional who can help me retrieve information from various sources. The ideal freelancer should be well-versed in web scraping, especially from websites, social media platforms such as LinkedIn, publications, and news sites. This will help in gathering relevant data for building a recommendation system. Key requirements include: - Proficiency in data scraping from multiple sources - Ability to effectively scrape data from websites, social media platforms like LinkedIn, and news sites - Experience with handling and storing data in a database - Understanding of how to structure and manage data for machine learning purposes Your task will be to gather the data and store it in a database for further analysis. Having a solid background in data handl...

I'm seeking a Python developer who's proficient in web scraping to help me extract data from social media platforms. Key Responsibilities: - Develop and implement a Python script for web scraping data from social media channels. Deliverable: - The scraped data should be compiled and delivered in an Excel spreadsheet for further analysis. Ideal Candidate: - Proficient in Python with a strong background in web scraping techniques. - Prior experience in scraping data from social media platforms will be a big plus. - Ability to deliver the end results in an organized, neat and easily accessible format, such as an Excel spreadsheet. Please reach out if you think you're the right fit with the necessary expertise.

I'd like to extract the phone numbers of real estate agents from a particular website Key Requirements: - Extract agent contact information Ideal Skills and Experience: - Proficiency in web scraping - Experience with data extraction and automation - Strong understanding of data privacy laws and regulations Please note that the data is intended for internal use only and will not be shared with any third-parties.

I'm in need of a comprehensive contact list for Queensland-based mine sites. I'd like the list to include: - Company name and contact details - Mine site location and address - Contact person and title I'm looking for a high volume of entries, so ideally more than 50 mine sites should be included. The final deliverable should be an Excel spreadsheet. Ideal freelancers for this project should be experienced in data mining and collection. You should be thorough and detail-oriented to ensure all information is accurate. Knowledge of Queensland's mining industry would be a plus.

I am seeking a proficient Python programmer who can create a web scraper for Lazada. Key Responsibilities Include: - Develop a Python program that will enter query in search box and scrape Lazada for the following data: product name, images, price, description, seller, and URL. - The scraper should be able to handle pagination plus also bypass captcha using 2captcha api Ideal Skills and Experience: - Proficiency in Python and web scraping frameworks. - Familiarity with the Lazada's web structure and data extraction. - Experience creating scrapers for e-commerce platforms. Website lazada .

I need a professional data entry specialist who can help me with inputting text-based data from digital files into a spreadsheet. Key Requirements: - Data Entry: The core task involves taking text data from digital files and accurately entering it into a spreadsheet. The data is not overly complex and primarily consists of straightforward text entries. - Skill with Spreadsheets: Proficiency in using spreadsheet software like Excel or Google Sheets is essential. The ability to accurately organize and input data into these platforms is crucial. - Attention to Detail: Precision is paramount. I need someone who can enter the data with great accuracy, ensuring that each entry is correct and in the right place. - Efficiency: While accuracy is key, speed is a factor too. I'm looking for ...

I need a professional data entry specialist who can help me with inputting text-based data from digital files into a spreadsheet. Key Requirements: - Data Entry: The core task involves taking text data from digital files and accurately entering it into a spreadsheet. The data is not overly complex and primarily consists of straightforward text entries. - Skill with Spreadsheets: Proficiency in using spreadsheet software like Excel or Google Sheets is essential. The ability to accurately organize and input data into these platforms is crucial. - Attention to Detail: Precision is paramount. I need someone who can enter the data with great accuracy, ensuring that each entry is correct and in the right place. - Efficiency: While accuracy is key, speed is a factor too. I'm looking for ...

I'm seeking a data aggregator for a unique AI training project. Key Tasks: - Gathering text content from official website/source of the particular product/entity. - Focusing specifically on product descriptions, specifications, price and other attributes. Ideal Skills: - Basic searching skills - Able to follow given format of data collection - MS Excel or Google Sheets This project requires precision, and the information gathered will contribute to an AI's learning process. Accuracy in aggregation is, therefore, key.

I'm looking to build a custom scraper for DeFi exchanges. The main features I'm interested in are: - Historical data analysis: This is crucial for me to make well-informed decisions about the market trends. - Real-time data updates: Although not explicitly stated in the questions, the bot will need to be able to update data in real-time. This will help me stay ahead of the market. I currently prefer the output in CSV format, as it is easy and widely used. Given the nature of the DeFi space, experience in cryptocurrency scraping bots is a must. It would be ideal to have experience with DeFi exchanges particularly. This project will require strong skills in programming languages such as Python, R, or JavaScript, as well as experience in data scraping and analysis.

IMPORTANT!! Start with the word in the atachment. All offers not starting as requested will be removed. We would like to have all fitness websites with embedded YouTube Videos Austria, Germany and Switzerland.

I am urgently in need of a freelancer with skills in web scraping, data extraction and web crawling. Your task will be to gather specific information from an online directory of race events throughout the world. Key Responsibilities: - Set up a weekly automated web scraping process. - Extract and deliver the following data points: Event name, Event date, Event location, online registration page, contact form page, and contact information along with some other info that we can grab. Required Skills and Experience: - Proficiency in web scraping and data extraction. - Capable of setting up an automated weekly process. - Ability to perform the task ASAP. - Strong attention to detail to ensure accuracy of information. Please note that timeliness and data accuracy are paramount in this proje...

I need a professional who can scrape and compile email lists of high net worth individuals with a particular income level and investment interests. The emails will be used to target our automated trading software offer. Key Requirements: - Income Level Criteria: The emails should target individuals with an income level within the range of $250,000 - $500,000. - Investment Interests: The targeted individuals should have an interest in the stock market, Futures trading, options trading, cryptocurrency, and real estate. Ideal Skills and Experience: - Proficiency in data scraping and email list compilation. - Familiarity with targeting high net worth individuals and their investment interests. - Previous experience in compiling email lists for targeted marketing campaigns.

I'm in need of a savvy professional who appreciates the finer details of Major League Baseball (MLB). You'll be tasked with compiling a comprehensive spreadsheet featuring specific MLB data. Essential parts of this data include game statistics, player performance, and team standings. The spreadsheet should be organized in a user-friendly way as mentioned below: 1. Date Range: The spreadsheet must cover a specified date range, which I'll provide upon hiring. 2. Included Players/Teams: The spreadsheet should cover designated players and/or teams - the specifics of which I'll supply once you're on board. 3. Additional Factors: In keeping with the finer details, the spreadsheet should also cover the Date of Game, Team A vs Team B data, analysis on which pitcher is b...

I am seeking a detail-oriented freelancer with demonstrable experience in data collection to gather texts, images, numbers, and tables from a particular website. My instructions, which will include 1 to 5 photographs, will guide you in precisely what data I need to be gathered. The freelancer will be expected to: * Carefully collect the specified data from the website * Ensure all text, images, numbers, and table-based data are meticulously compiled * Consolidate all the collected data into a neat Excel spreadsheet Your experience in data collection should be highlighted in your application. Experience in using Excel for data organization will be a key advantage.

I'm looking for a skilled data scraper who can help me extract contact information from Website 1 and deliver it in Google Sheets. Key Requirements: - Scraping: The primary task is to scrape contact information from Website 1. - Data Delivery: I prefer the scraped data to be delivered in Google Sheets. Ideal Skillset: - Web Scraping: A strong understanding of web scraping techniques and tools is essential. - Data Handling: Proficiency in handling and organizing data in Google Sheets is preferred. Please ensure that you have prior experience with similar projects and can provide a sample of your work for review.

Crawl, extract, build and publish all Docker Hub, , GitHub, BitBucket, GitLab, Snapcraft, Flatpak, AppImages, DC++, eMule, BitTorrent and SoulSeek as deb packages (APT repository), from ISO, container images, and source code files. Also will run a web server. More details: Is this project for business or personal use? Personal What information should successful freelancers include in their application? Detailed project proposals How soon do you need your project completed? No time limit

I need a skilled Python developer to assist in extracting specific text data from a series of PDFs. The extracted data should be organized in a nested JSON format. Key project requirements: - **Data Extraction:** The task involves extracting text from the PDFs. - **Data Structuring:** The extracted data should be organized as nested objects in JSON. Ideal skills and experience: - **Python Proficiency:** A strong command over Python is crucial for this job. - **PDF Processing:** Experience with PDF processing libraries in Python is a big plus. - **JSON Formatting:** Ability to structure data into nested objects in JSON format. Deliverable: -Someone interested with AI also beneficial - The extracted data should be presented in a JSON format, and the code should be well-commented an...

We are looking for a Node.js, Playwright, and Puppeteer developer to work on our existing project. The candidate will be responsible for writing custom drivers to download data from specific sites. This is a long-term job opportunity. Fully remote work with flexible hours. Starting wage of $1000 per month, with potential increases based on performance and skill. The standard working week consists of 40 hours with 2 days off. Initial Proposal Requirement: Include the phrase “I AM A VERY GOOD HUMAN” at the beginning of your proposal to confirm that you have read and understood all the requirements.

Hello : i need do a simple bot for aumatization of some simples task, please fell free to contact me. Thanks

I wanna create script in extracting or scraping the subscriber data from a large Telegram channel and groups. The ultimate goal is to invite these subscribers to my own channel. Key Results: - Extract or scrape customer data from specified Telegram channels or Groups. - The type of data required is mainly (phone number - user) - Extracting data from private channels or groups - Provides a complete list of extracted customers - Ensure customer data is ready to easily import into my channels for invitations Ideal Skills & Experience: - Proficiency in web scraping tools and techniques - Experience with Telegram algorithms - Experience with Telegram API or similar platforms - Proven track record in handling and managing large amounts of data - Strong communication skills to provide detai...

I need a professional data extractor to extract leads from websites on a weekly basis. Key Requirements: - Extracting email id and mobile numbers: The task involves scraping textual data only, and not images - Websites as source: The data should be scraped from various websites, so a good understanding of web scraping is crucial. - Weekly updates: The extraction will need to be performed every week, so the ability to automate or efficiently manage unique scraping is essential. Ideal Skills and Experience: - Web scraping: Proficiency with tools and techniques for web scraping, especially for textual data. - Automation: Experience with automating scraping processes for repeated extraction. - Accuracy and reliability: The extracted data must be complete and accurate, ensuring a reliable a...

I require a professional data scraper to scrape multiple websites. Key tasks include: - No limitation on type of data scraped as this was not specified. - Scraping must be done across multiple websites, specifics will be provided upon project commencement. - All data should be delivered in Excel spreadsheet format. Ideal skills and experience: - Prior experience in web scraping across multiple diverse websites. - Proficient in using different scraping tools. - Strong understanding of Excel and data parsing. - Attention to detail and commitment to high quality, error-free work.

I'm in need of an experienced data scraper to scrape and collect text data from multiple websites including social media platforms. It's a high-volume job with an emphasis on accuracy and efficiency. Ideal Skills and Experience: - Proficiency in data scraping tools and software - Experience with scraping text data from multiple sources - Familiarity with various types of websites and social media platforms - Fast turnaround time, without compromising the quality of work - Attention to detail is paramount - Previous experience in similar projects would be a plus Please bear in mind, I need someone capable of navigating multiple websites for meaningful extraction, we're not just talking surface-level data scraping. This project requires depth and precision.

I'd like to extract the phone numbers of real estate agents from a particular website Key Requirements: - Extract agent contact information Ideal Skills and Experience: - Proficiency in web scraping - Experience with data extraction and automation - Strong understanding of data privacy laws and regulations Please note that the data is intended for internal use only and will not be shared with any third-parties.

I need a freelancer who can gather the 'following' lists from Instagram for a large set of users. This project is centered around social media analysis and trend prediction. Key Points: - You will only be required to generate a list of followed accounts' IDs for each user that is provided - The data you collect will be used to predict trends in user behavior and preferences Ideal Skills and Experience: - Proficiency in data scraping, particularly from social media platforms - Familiarity with Instagram's API and limitations Further notes - I am very familiar with scraping in general myself. There are many obstacles with Instagram - namely, the endpoint where the 'following' list is found requires a logged in sessionid. I have a very large list of users (11...

I'm in need of help with fetching influencer data from Instagram, YouTube, and TikTok. The specific data needs are not completely defined at this moment, so the ability to adapt is essential. The end goal of this data collection is currently open-ended. Key skills and experience needed: - Deep understanding of Instagram, YouTube, and TikTok - Experience in data mining or web scraping - Proficient in data analysis - Flexible and adaptable work approach.

I'm seeking a developer to help me create a system that can archive web-based content, including text and images, for offline viewing. Key Requirements: - Archive text and images: The system should be able to save text and image content from websites. Use appropriate tools like HTTrack, Wget, or WebCopy to mirror the website. - Single archive process: The content will require archiving only once, as it won't be updated frequently. Ideal Skills: - Proficient in web scraping: Ability to extract and save content from websites. - Experience with archiving systems: Previous work on systems that save web content for offline use. - Knowledge of offline storage: Understanding of how to save and retrieve content without requiring an internet connection. This project is ideal for someon...

We are looking for someone who has knowledge in web scraping and building mobile apps. Please do not apply if you don't have experience in both. As we are in the final stretch of our MVP (native iOS and Android mobile app), this individual will help us finish a critical feature in the app (i.e., web scraping) + other small features and help us launch in app stores. Please take a look at the attached high level SOW before you submit the bid AND include your time commitment (hours/week) and hourly rate. We will select candidates based on the bids. The detailed SOW will then be shared with the selected candidate/s before finalizing timeline & budget. Acceptance criteria will be provided once we move forward with the selected candidates. Tech stack: Frontend: React Nativ...

I'm seeking an experienced and knowledgeable data scraping professional to collect specific information from three major platforms - RERA websites (specifically Maharashtra, Telangana, Haryana, and Delhi), Google, and Justdial. Here's what I am looking for: Details to Scrape: - Name - Mobile Numbers - Locality - City - Address - Pincode Platforms: - RERA Websites (Maharashtra, Telangana, Haryana, Delhi) - Google (DSA and Loan Agents data) - Justdial (DSA and Loan Agents data) The ideal freelancer for this job will be highly experienced in data scraping and will be able to deliver the results in an organized manner. Proficiency in scraping from Google, RERA websites, and Justdial is particularly important. Delivery Format: - The data should be delivered in an excel file fo...

Hello I am looking for a python code to scrape a large number pages and save them as html. In order to get to the page to save, you must click a radio button, submit, and then enter a string of numbers, then submit and then save the html. If the string entered provides an error then you must skip to the next iteration. There is no human verification. I already have a version I made myself that works with Selenium, however I need to increase the speed, so I am looking for someone to see if its possible to do this without even opening a browser and possibly using direct call methods (get, request, cURL, response, JSON?). It should be a simply project for someone who knows how to do this. Please enter the result of 3+2 for your message to be received.

I'm looking for a skilled data scraping professional to assist me with a project. I had a working script in Python using an API, but the company implemented a Cloudflare protection that is always blocking me. You would need to find a solution how this could be circumvented (e.g. proxies) and large amounts of data be scraped. If you are interested, I am happy to provide more details privately.

I'm currently seeking a skilled freelancer for a data entry job concerning primarily text data. The data to be entered will be provided in an Excel spreadsheet and will need to be accurately transferred to an online database. Ideal candidates should have: - Proficiency in Microsoft Excel - Experience with data entry into online databases - Attention to detail and accuracy Please place your bid based on the information provided, and get ready to embark on an engaging and fulfilling data entry task.

I'm seeking a Python developer with experience in Playwright to complete my existing code. Key tasks include: - Reviewing the existing codebase. - Identifying and fixing bugs. - Completing partial functionalities if any. Ideal candidate should have: - Prior experience with Python (Playwright). - A strong understanding of web scraping and UI automation. Please provide examples of your past work in Python (Playwright) along with your bid.

I’m looking for some help doing a bit of automation with headless browsers. I have some scripts working already using node.js and playwright but need some support and help with the scripts. I'm also open to using puppeteer or selenium if needed. Will pay hourly for support. Thanks!

I'm in need of a skilled programmer to assist me in automating daily pricing updates from a specific website. The script should pull the pricing information and update it into our system. Key Requirements: - Develop a script that can extract data from a website and automate the pricing update process - The script should be able to run daily, without manual intervention - Ensure the script is robust and can handle occasional changes in the website's layout without breaking Ideal Skills and Experience: - Proficient in web scraping and data extraction - Experienced in script automation, particularly on a daily basis - Familiarity with handling data within a business context - Ability to create a reliable and sustainable solution, accommodating for potential changes in the website...

I require a professional data scraper to scrape multiple websites. Key tasks include: - No limitation on type of data scraped as this was not specified. - Scraping must be done across multiple websites, specifics will be provided upon project commencement. - All data should be delivered in Excel spreadsheet format. Ideal skills and experience: - Prior experience in web scraping across multiple diverse websites. - Proficient in using different scraping tools. - Strong understanding of Excel and data parsing. - Attention to detail and commitment to high quality, error-free work.