Developer Needed for Large-Scale Product Scraping and Database System
Budget: -
HOURLY / PART_TIME
⭐ 4.76 (17)
United States
python, data-scraping, api
We are looking for an experienced developer to build and manage a large-scale product scraping and database system.
The system should collect up to 1 million product listings daily from major retail websites and reputable eBay sellers. It must capture product titles, brands, UPCs, prices, availability, variations, product URLs and image URLs.
The developer will also build and manage the database, prevent duplicate products, monitor price and inventory changes, and keep the scrapers working when websites change.
The monthly operating budget for servers, databases, proxies and scraping services should remain close to $1,000.
Please include:
* Similar systems you have built
* Your recommended setup
* Estimated development cost
* Expected monthly operating cost
* How you would realistically handle this volume
We are looking for someone experienced, practical and available for ongoing maintenance—not someone offering a basic scraper.
Openen op Upwork