Web Scraping - Full-Time Position

Full-time regular job We are seeking an experienced Python Developer to design, maintain, and enhance web scrapers for multi-level product data collection. Responsibilities: 1. Develop and maintain web scrapers 2. Extend scrapers based on evolving requirements 3. Set up automated execution pipelines 4. Ensure data accuracy and optimize request/traffic usage 5. Produce and maintain technical documentation Requirements: 1. Strong experience in Python-based web scraping 2. Solid SQL knowledge 3. Experience with Azure CI/CD pipelines 4. Ability to collaborate effectively within a team Write answer on the question "What approach are you going to use for huge volume data collection?" in the beginning of your bid. Thank you for your time.