Job Title: Senior Data Pipeline Engineer – Automated API Development (Edmonton Data)

Job Title: Senior Data Pipeline Engineer – Automated API Development (Edmonton Data) Project Overview: I am building a B2B data licensing business that provides a real-time, API-accessible stream of commercial construction and development permits for the Edmonton region. I am looking for an experienced Data Pipeline Engineer to build a robust, fully automated, and self-healing extraction and delivery system. Technical Deliverables: Automated Scraper: Build a Python-based scraper that extracts daily building/development permit data from City of Edmonton open data portals. Standardized Database: Store data in a PostgreSQL schema (AWS RDS or Supabase) with normalized fields (Date, Value, Geo-coordinates, Project type). API Development: Build a RESTful API (using FastAPI or similar) that allows third-party aggregators to query the data securely. Data Normalization Logic: Dates: Convert to ISO 8601 (YYYY-MM-DD). Currency: Clean currency symbols and commas (Float format). Geocoding: Automatically integrate with Google Maps or OpenStreetMap API to add Lat/Lng coordinates for every address. Deduplication: Logic to prevent record duplication on daily runs. Serverless Infrastructure: The entire stack must be hosted on a cost-efficient, serverless architecture (e.g., AWS Lambda, EventBridge) to ensure 99% uptime with minimal overhead. Data Dictionary Requirement: The output must adhere to this JSON schema: permit_id, issue_date, permit_type, project_value, address, geo_lat, geo_lng, business_name, description, raw_source_url. Required Experience: Expert-level Python and SQL. Deep experience with serverless deployment (AWS). Experience building public-facing APIs with authentication (API Keys). Ability to write self-healing code (e.g., automated error logging/notifications). Proposal Requirement: Please include the word "EDMONTON" at the start of your proposal. Additionally, please briefly describe the tech stack you would use to keep monthly hosting costs under $50.