Scraping , Data Extraction, Automation Expert
Budget: $10.0 - $20.0
HOURLY / FULL_TIME
⭐ 4.70 (20)
IDN
data-scraping, data-extraction, python, selenium, automation
Gewenste kwalificaties
- Ervaring: Expert
We’re looking for an experienced Python/web scraping developer to build a system that can automatically find a company’s manufacturing plants, warehouses, distribution centers, and fulfillment centers using official company sources.
What the system should do
The system will receive a company name + website domain and automatically search sources such as:
Company websites and subdomains
Supplier/vendor portals
Career pages and job postings
PDFs and spreadsheets
Facility/location pages
Interactive maps
Public APIs used by company websites
It should identify relevant facilities and return:
Facility name
Address
City/location
Facility type
Source URL
Supporting evidence from the source
The system should exclude offices, retail stores, R&D locations, and other non-operational facilities.
Important: This must be a general system
We do not want a separate scraper built for each company.
The goal is to create a reusable system that works across many different companies and website structures.
For example, the same system should be able to research different companies without requiring custom code for each one.
Technologies / experience
You should have strong experience with:
Python
Web scraping and automation
Playwright, Selenium, Scrapy, or similar tools
JavaScript-rendered websites
Inspecting APIs and interactive maps
PDF and Excel/CSV extraction
LLMs for classification and data extraction
Data cleaning, normalization, and duplicate detection
Accuracy is very important
We care more about reliable results than finding every possible facility.
Every facility should have a clear source and supporting evidence. The system should also be able to identify uncertain results and assign confidence/review statuses.
Research should stop after a defined number of official sources rather than continuing indefinitely.
What we'd like from you
Please describe:
Similar web scraping/data extraction systems you have built.
How you would design this as a company-agnostic system.
How you would handle websites, APIs, PDFs, spreadsheets, maps, and job postings.
How you would verify facilities and avoid false positives.
Your preferred technology stack.
We’re looking for someone who can build clean, maintainable, well-documented code and create a system that can improve over time as we test it on different companies.
Openen op Upwork
AI proposal draft
Generate a short cover letter for this job. Edit before sending.
Sign in to generate an AI proposal draft.
Inloggen