Data scrapping Angular/Python
Budget: $6.0 - $19.0
HOURLY / PART_TIME
⭐ 0.00 (0)
etl-pipelines, data-extraction, etl, crawlers, python, data-scraping, api
Bevorzugte Qualifikationen
- Erfahrung: Einsteiger
Looking for an experienced backend developer to build a standalone (macOS)/web based, ready-to-run data scraping tool. The target platform is a large marketplace built on an AWS-backed microservices infrastructure utilizing C# .NET, Python, and Angular. It employs modern anti-bot and rate-limiting measures. We require a resilient solution that handles these protections cleanly.
Deliverable
The final handover must be a complete, operational software delivery package, web-based or standalone, and not just a raw code. Your submission must include:
1. A functional tool of your choice (a terminal-based CLI tool or a very basic desktop UI) to run natively on macOS without requiring to fix broken environment.
2. The Output Dataset: The tool must instantly generate a structured Excel (.xls / .xlsx) file containing all valuable data fields available.
3. Source Code & Documentation: Clean, modular Python source code along with a straightforward README.
Required Excel Data Schema (Columns):
Technical Requirements
• Mac Optimization: Must execute seamlessly on macOS via your chosen platform/architecture.
• Stack of Choice: This marketplace is built using modern Python frameworks (such as Playwright, Scrapy, or Selenium).
• Resilience: Implemented with smart request delays, browser context rotation, and robust exception handling to ensure long-running extraction job don't crash.
• Data Processing: Auto-cleans and formats numerical values (like stripping currency symbols from price and "km" from KMs) into a clean spreadsheet ready for data analysis.
Auf Upwork öffnen
AI proposal draft
Generate a short cover letter for this job. Edit before sending.
Sign in to generate an AI proposal draft.
Anmelden