← Lavori

Python Data Engineer: Automated Public Records Pipeline & Supabase Integration (3 FL Counties)

Budget: $200.0 FIXED / ⭐ 5.00 (1) USA

python, data-extraction, data-scraping, etl-pipelines, postgresql, linux

Qualifiche preferite

  • Esperienza: Intermedio
We have an active, production-tested automated data extraction pipeline running on an Ubuntu DigitalOcean droplet. The system queries Florida county Official Records dockets (Lis Pendens, Liens, Deeds), joins parcel data against county property appraiser rolls (NAL data), and upserts clean records into Supabase on a daily cron schedule. We need an experienced Python data engineer to audit the existing deployment, ensure pipeline integrity, and expand the data pipeline across three additional Florida counties: Pinellas, Pasco, and Orange. Scope of Work & Deliverables: 1. Deployment Audit & Pipeline Verification Review the existing deployment on our DigitalOcean droplet (hillsborough/). Verify Supabase database schema mappings, upsert logic, and daily cron execution. Execute backtesting runs across historical lookback windows (RE_FETCH_WINDOW_DAYS = 7) to confirm deduplication, data consistency, and proper error handling. 2. Regional Docket Expansion (Pinellas, Pasco, Orange) Adapt our existing extraction framework to target Official Record dockets and Property Appraiser rolls for: Pinellas County Pasco County Orange County Extract key instrument types: Lis Pendens (LP), Liens (LN), and Deeds/Conveyances. Implement our parcel matching engine (joining against NAL / appraiser rolls to resolve parcel folios, situs addresses, and owner mailing details). 3. Server Deployment & Automation Deploy the expanded pipelines to the existing DigitalOcean droplet. Configure daily cron automation for each county with 7-day lookback windows to capture indexing lags. Map Supabase tables and verify clean ingestion with zero record drops across all three new markets. Milestone Breakdown ($200 Total Fixed Price): Milestone 1 ($50): Deployment audit, backtest check, and Pinellas pipeline live in Supabase. Milestone 2 ($75): Pasco pipeline connected, tested, and syncing to Supabase. Milestone 3 ($75): Orange County pipeline live, all cron tasks active and verified. Required Qualifications: Strong Python experience (HTTP clients, session handling, API/form payloads, data wrangling). PostgreSQL / Supabase integration and upsert management. Linux / Ubuntu Server administration and Cron automation. Prior experience handling Florida municipal records, county clerk dockets, or property appraiser datasets. To Apply: Briefly describe your experience with Florida county public records, automated ETL pipelines, and Python/Supabase workflows. Start your proposal with the word "PIPELINE" to confirm you have reviewed the full project scope.
Apri su Upwork

AI proposal draft

Generate a short cover letter for this job. Edit before sending.

Sign in to generate an AI proposal draft.

Accedi