← Lavori

Senior Data Engineer

Budget: - HOURLY / FULL_TIME ⭐ 4.91 (150) United States

Qualifiche preferite

  • Tipo di talent: Indipendente
  • Esperienza: Intermedio
We are seeking a Senior Data Engineer to build and maintain secure, reliable, and scalable data pipelines, warehouse models, and analytical datasets supporting people insights. This role combines hands-on data engineering with data modeling, platform reliability, semantic-layer design, and governed access for both business intelligence tools and AI-enabled interfaces. Enterprise experience strongly preferred. Key Responsibilities - Develop and maintain secure, efficient data pipelines using dbt, PySpark, and Python applications. - Build extraction, transformation, and loading infrastructure using Python, dbt, Terraform, AWS Glue, Amazon EMR, and Amazon S3. - Integrate data from APIs, cloud systems, Google Sheets, and other structured sources. - Create and maintain Snowflake warehouse models, datamarts, and analytics-ready datasets. - Develop automated data-quality tests and improve internal data-engineering processes. - Monitor production pipelines and help maintain a 99.5% uptime objective. - Design semantic views, ontology layers, business-friendly entities, relationships, and certified metrics over warehouse models. - Build governed natural-language data experiences using Snowflake Cortex Analyst, Cortex Search, or equivalent LLM-native query layers. - Configure secure Model Context Protocol connections or comparable interfaces between governed data sources and internal AI tooling. - Document data models, pipelines, business logic, operational procedures, and technical decisions comprehensively. Must-Have Skills - 5+ years of relevant experience. - Hands-on Snowflake experience, including data modeling, datamarts, and data warehouse design. - Hands-on dbt experience for data transformations. - Strong Python experience, including object-oriented programming and data scripting. - Hands-on Airflow experience for pipeline orchestration. - Experience integrating REST APIs and ingesting data from external sources. - Hands-on Google BigQuery querying and optimization experience. - Experience securely handling sensitive data at large scale. - Experience with real-time or near-real-time data processing from APIs, Google Sheets, or comparable sources. - Strong SQL skills, including highly optimized queries. - Comprehensive technical documentation skills. - Advanced English communication skills. Nice-to-Have Skills - Experience designing semantic layers or semantic models that provide business-object abstraction over dbt and warehouse models. - Experience with Snowflake Cortex Analyst, Cortex Search, or an equivalent LLM-native query layer. - Experience with Model Context Protocol or a similar tool-calling and context-exposure framework. - Familiarity with prompt and context engineering for grounding AI agents in certified data sources. Required Tools & Platforms - Snowflake. - dbt. - Python and PySpark. - Apache Airflow. - Google BigQuery. - SQL. - REST APIs. - Terraform. - AWS Glue, Amazon EMR, and Amazon S3. Location, Time & Engagement - Candidates must be based in LATAM. - Full US Central Time coverage is required. - This is a contract engagement at 40 hours per week. - The anticipated engagement runs through March 31, 2027. - This is not currently a contract-to-hire opportunity.
Apri su Upwork

AI proposal draft

Generate a short cover letter for this job. Edit before sending.

Sign in to generate an AI proposal draft.

Accedi