Data Scraping Specialist Needed for Discrete Web Data Extraction

We’re looking for an experienced software engineer with strong web scraping and automation skills to join our existing team on a data extraction project. You’ll build a reliable solution to extract specific data from a website that requires authenticated access. Accuracy, secure credential handling, and confidentiality are essential. All access and data collection must be authorized and comply with applicable website terms. Responsibilities: - Develop and implement a scraping solution to extract structured data from the specified website. - Handle authorized login processes, session cookies, or supported APIs securely. - Clean and organize extracted data into an agreed format, such as CSV, JSON, or a database. - Build appropriate error handling, logging, and retry mechanisms. - Test and validate data accuracy, completeness, and scraping reliability. - Collaborate with our existing engineer, provide progress updates, and flag blockers early. - Document setup, operation, and maintenance of the solution. - Maintain strict confidentiality and protect credentials and sensitive data. Requirements: - Proven experience in software development, web scraping, and browser automation. - Proficiency with Python tools such as BeautifulSoup, Scrapy, or Selenium; JavaScript-based tools; or similar frameworks. - Strong understanding of website authentication, session management, cookies, and APIs. - Experience working with structured and unstructured data. - Familiarity with rate limits, proxies, CAPTCHA challenges, and anti-bot protections, using permitted approaches without bypassing access controls. - Strong debugging skills, attention to detail, and clear communication. - Ability to work independently and deliver reliable, maintainable code. Deliverables: - A working scraping solution, including source code and setup instructions. - Cleaned and validated data in the agreed format. - Documentation covering authentication setup, execution, dependencies, and known limitations. - A handoff walkthrough with our team. To apply, please include: - Examples of relevant scraping projects, particularly those involving authenticated websites, without sharing confidential client information. - Your proposed approach to secure login, credential protection, and confidential data handling. - The tools or frameworks you recommend and why. - Your estimated timeline, fixed-price quote, weekly availability, and earliest start date. - Your role in the projects shared and links to relevant work or your resume. We value thoughtful problem-solving, clear communication, and dependable results.