Python Web Scraping Expert for Data Extraction from Websites

We are currently looking for an experienced and reliable Python Web Scraping Specialist to help us extract data from multiple public websites and web applications. Project Overview: We need someone who can build robust, efficient, and scalable web scrapers to collect data from various websites. The websites may include both static and dynamic (JavaScript-rendered) pages. The scraped data should be clean, well-structured, and delivered in usable formats. Responsibilities: Build and maintain web scrapers using Python Extract data from both static and dynamic/JavaScript-rendered websites Handle anti-scraping protections and bypass mechanisms Work with rotating proxies and user-agent rotation Handle CAPTCHAs when encountered (manually or using solving services) Clean, structure, and store the extracted data properly Write clean, well-documented, and maintainable code with proper error handling and logging Deliver data in the required format (CSV, JSON, Excel, or database) Required Skills: Strong proficiency in Python Experience with BeautifulSoup, Requests, and Scrapy Strong experience with Playwright (preferred) or Selenium for handling dynamic/JavaScript-rendered pages Solid knowledge of HTML, CSS, XPath, and CSS Selectors Basic understanding of JavaScript (since many modern websites rely on it) Experience dealing with Anti-Scraping Protection (such as Cloudflare, DataDome, PerimeterX, etc.) Experience working with rotating proxies and user-agent rotation Ability to handle CAPTCHAs or integrate CAPTCHA-solving services Proficiency in Pandas for data cleaning and processing Experience storing data in CSV, JSON, Excel, or databases (PostgreSQL or MongoDB) Strong skills in error handling and professional logging Willingness to train and transfer knowledge to our internal team Preferred Skills (Big Plus): Experience with the Scrapy framework Preference for using APIs when available instead of scraping Experience with task scheduling (Cron Jobs, Airflow, or Prefect) Previous experience scraping large-scale or complex websites Good understanding of ethical scraping practices and respecting robots.txt What to Include in Your Proposal: Your experience with web scraping projects (please share 1-2 examples or links if possible) Which tools and techniques you use to handle dynamic websites and anti-scraping measures Your approach to data storage and error handling Your hourly rate or fixed price for similar projects We are looking for a professional, communicative, and detail-oriented freelancer who can deliver reliable and high-quality scraping solutions. The selected candidate must also be willing to train our internal team on the necessary skills, tools, and techniques required to perform this type of work internally in the future. Note: This engagement will start as a single project on an hourly basis. If performance and results are satisfactory, there is strong potential for ongoing or long-term collaboration. Looking forward to your proposals