Automated Webscraping specialist

We are looking for an experienced developer to build and maintain a high-volume data extraction pipeline for 3–4 websites (protected by Cloudflare and DataDome). The data must be collected, processed, and submitted automatically to our application immediately after extraction. Scope - Extract full structured data from 3–4 sources. - Process approximately 200,000 websutes per day, potentially up to 400,000 if sources run twice daily. - automatically submit data to our system - Maintain the pipeline, monitor failures, and adapt quickly when sources change. Requirements The target websites use Cloudflare and DataDome. You must have proven experience with large-scale, production-grade data collection from technically protected websites. Please include: - Relevant examples of similar projects. - Experience with Cloudflare, DataDome, browser automation, sessions, rate limits, proxies, and JavaScript-rendered pages. - Your recommended technical approach and stack. - How you would handle monitoring, reliability, and ongoing maintenance. Infrastructure The system should be hosted on cloud infrastructure provided by us. You will receive full server access and take ownership of your part of the setup, deployment, monitoring and maintenance. This is a long-term role. We are looking for someone reliable who can operate and improve the system over time.