Developer Required for E-commerce Scraper Implementation
Budget: -
HOURLY / PART_TIME
⭐ 0.00 (0)
India
data-extraction, api-integration, scrapy-framework, selenium, automation, crawlers
We are looking for an experienced developer to build and implement web scrapers for around 7 e-commerce websites.
The scraper should collect product-related data such as product name, price, stock availability, product URL, image URL, brand, category, and other available product details. The data should be structured and exported in a clean format for further use.
Scope of Work
The developer will be responsible for:
1. Building scrapers for approximately 7 e-commerce websites.
Extracting product details, pricing, stock status, images, and product URLs.
2. Handling pagination, categories, and product listing pages.
3. Managing price and stock updates on a scheduled basis.
4. Ensuring data accuracy and avoiding duplicate products.
5. Providing clean output in CSV, Excel, database, or API format.
6. Setting up error logs and basic monitoring for failed scrapes.
7. Ensuring the scraper follows best practices and works with publicly available data only.
Deliverables
1. Fully working scrapers for all assigned websites.
2. Structured product data output.
3. Documentation on how to run and maintain the scrapers.
4. Source code with setup instructions.
5. Basic error handling and logs.
6. Scheduled scraping setup.
Questions for Applicants
1. Have you built e-commerce scrapers before? Please share examples.
2. Which scraping tools or frameworks do you prefer using?
3. Can you handle JavaScript-heavy websites?
4. How do you manage blocked requests, rate limits, and failed scrapes?
5. Can you provide clean documentation and reusable code?
6. What timeline would you suggest for implementing scrapers for 7 websites?
Apri su Upwork