Python Data Engineer: Automated Public Records Pipeline & Supabase Integration (3 FL Counties)
Buget: $200.0
FIXED /
⭐ 5.00 (1)
USA
python, data-extraction, data-scraping, etl-pipelines, postgresql, linux
Calificări preferate
- Experiență: Intermediar
We have an active, production-tested automated data extraction pipeline running on an Ubuntu DigitalOcean droplet. The system queries Florida county Official Records dockets (Lis Pendens, Liens, Deeds), joins parcel data against county property appraiser rolls (NAL data), and upserts clean records into Supabase on a daily cron schedule.
We need an experienced Python data engineer to audit the existing deployment, ensure pipeline integrity, and expand the data pipeline across three additional Florida counties: Pinellas, Pasco, and Orange.
Scope of Work & Deliverables:
1. Deployment Audit & Pipeline Verification
Review the existing deployment on our DigitalOcean droplet (hillsborough/).
Verify Supabase database schema mappings, upsert logic, and daily cron execution.
Execute backtesting runs across historical lookback windows (RE_FETCH_WINDOW_DAYS = 7) to confirm deduplication, data consistency, and proper error handling.
2. Regional Docket Expansion (Pinellas, Pasco, Orange)
Adapt our existing extraction framework to target Official Record dockets and Property Appraiser rolls for:
Pinellas County
Pasco County
Orange County
Extract key instrument types: Lis Pendens (LP), Liens (LN), and Deeds/Conveyances.
Implement our parcel matching engine (joining against NAL / appraiser rolls to resolve parcel folios, situs addresses, and owner mailing details).
3. Server Deployment & Automation
Deploy the expanded pipelines to the existing DigitalOcean droplet.
Configure daily cron automation for each county with 7-day lookback windows to capture indexing lags.
Map Supabase tables and verify clean ingestion with zero record drops across all three new markets.
Milestone Breakdown ($200 Total Fixed Price):
Milestone 1 ($50): Deployment audit, backtest check, and Pinellas pipeline live in Supabase.
Milestone 2 ($75): Pasco pipeline connected, tested, and syncing to Supabase.
Milestone 3 ($75): Orange County pipeline live, all cron tasks active and verified.
Required Qualifications:
Strong Python experience (HTTP clients, session handling, API/form payloads, data wrangling).
PostgreSQL / Supabase integration and upsert management.
Linux / Ubuntu Server administration and Cron automation.
Prior experience handling Florida municipal records, county clerk dockets, or property appraiser datasets.
To Apply:
Briefly describe your experience with Florida county public records, automated ETL pipelines, and Python/Supabase workflows. Start your proposal with the word "PIPELINE" to confirm you have reviewed the full project scope.
Deschide pe Upwork
AI proposal draft
Generate a short cover letter for this job. Edit before sending.
Sign in to generate an AI proposal draft.
Autentificare