Python/Django Developer — Product Crawler for Deals Aggregation Platform (Fixed Price)

We're building a deals aggregation platform that crawls retailer and bank websites to surface live discounts and product deals. We need a developer to build and deploy a product crawler covering a set of retailer sites. These are heavily JS-rendered sites with large page payloads, so the crawler needs to handle full browser rendering rather than a lightweight scraping approach. The crawler feeds a pipeline that takes raw scraped products through cleaning, scoring, and price verification before publishing as live deals. This crawler must integrate into our existing Django backend and admin dashboard, following the same structure as our existing crawlers (triggerable from Django admin, logging status, errors, and run history the same way our other crawlers do). Final code and the deployed build are to be delivered on our existing server infrastructure, not run independently elsewhere. Scope of work: Build crawler logic for the retailer sites we provide, using full browser rendering suited to JS-heavy pages Integrate crawler into our Django backend, following existing project conventions Connect crawler output to our existing product pipeline tables in Supabase Deploy and configure the crawler on our server Provide a short handover doc covering how the crawler runs, how to trigger it, and how to debug failures Milestones (fixed price, paid per milestone): Crawler working locally against 3 to 5 sample retailer sites, output reviewed and approved Full integration into Django admin/dashboard, all target retailer sites covered Deployed to our server, running end to end, output verified in production, handover doc delivered Requirements: Strong Python and Django experience Experience with browser automation for JS-rendered sites (Playwright, Puppeteer, or similar) Comfortable working inside an existing codebase and following its conventions Clear communication on progress at each milestone All code, deployed builds, and deliverables produced under this contract are our property upon payment of each milestone.