← Jobb

Senior Python/AsyncIO Engineer: Fix "Thundering Herd" & Non-Blocking Architecture

Budget: $400.0 FIXED / ⭐ 5.00 (1) SEN

python, data-extraction, scrapy-framework, selenium, etl-pipelines, automation, browser-automation, api-integration, api-development, postgresql, sql, artificial-intelligence

Föredragna kvalifikationer

  • Erfarenhet: Medel
We have an existing Python automation script (using nodriver and asyncio) that interacts with a high-traffic web portal. During peak traffic hours (a classic "Thundering Herd" scenario), the target server becomes unresponsive. Our current fetch request hangs for 15+ seconds, causing a cascade of TypeError: Failed to fetch errors. Your Mission (Fixed Price: $300 - $400): 1. Thundering Herd Mitigation: Implement a strictly non-blocking architecture. You must use asyncio.wait_for (or equivalent JS AbortController inside the browser) with a strict timeout and an immediate retry loop. The bot must never hang, even if the server drops the connection. 2. Form Automation: Automate a multi-step form (dynamic fields, file upload, final click) using nodriver. I already have the exact HTML source code of this form. Requirements: Expert in Python, AsyncIO, and nodriver. Experience with high-frequency, low-latency systems (trading, real-time data aggregation).
Öppna på Upwork

AI proposal draft

Generate a short cover letter for this job. Edit before sending.

Sign in to generate an AI proposal draft.

Logga in