← Jobb

Data Engineer (Google Cloud Platform) | BigQuery, Dataflow, ETL & Python

Budget: $35.0 - $80.0 HOURLY / FULL_TIME ⭐ 0.00 (0) Canada

sql, apache-spark, etl-pipelines, google-cloud-platform, amazon-web-services, python, java

Summary: We are looking for an experienced Data Engineer to join our growing team on multiple long-term client projects. You'll be responsible for building scalable data pipelines, designing modern data architectures, and helping clients transform raw data into actionable insights. Our projects span SaaS, healthcare, fintech, eCommerce, and analytics platforms, so we're looking for someone who enjoys solving real-world data challenges. This is an ongoing opportunity for a reliable engineer who communicates well, takes ownership, and can work independently. Responsibilities * Design, develop, and maintain scalable ETL/ELT pipelines. * Build and optimize data warehouses using BigQuery. * Develop batch and streaming data pipelines using Dataflow and Pub/Sub. * Integrate data from APIs, databases, cloud storage, and third-party platforms. * Write efficient SQL queries for large datasets. * Automate workflows using Cloud Composer or similar orchestration tools. * Ensure data quality, governance, and monitoring across pipelines. * Optimize query performance and cloud infrastructure costs. * Collaborate with software engineers, analysts, and stakeholders to define business requirements. * Troubleshoot production issues and implement long-term solutions. * Document architecture, workflows, and deployment processes. Required Skills: * 5+ years of professional Data Engineering experience. * Strong experience with Google Cloud Platform (GCP)/AWS. Hands-on expertise with: * BigQuery * Dataflow * Pub/Sub * Cloud Storage * Cloud Functions * Cloud Composer * Advanced SQL skills. * Strong Python programming experience. * Experience building production ETL/ELT pipelines. * Knowledge of data modeling (star schema, dimensional modeling). * Experience with Git and CI/CD workflows. * Familiarity with Docker and Terraform is a plus. * Excellent communication skills in English. Nice to Have: * Google Cloud Professional Data Engineer Certification. * Experience with Apache Beam. * Knowledge of Spark or Dataproc. * Experience with dbt. * Looker or Looker Studio experience. * Experience working in Agile/Scrum teams. * Familiarity with Airflow. * Experience migrating workloads to Google Cloud. What We're Looking For: * Strong problem-solving abilities. * Ability to work independently with minimal supervision. * Someone who writes clean, maintainable code. * Detail-oriented and proactive. * Long-term availability. * Comfortable working across multiple client projects. To Apply: Please include the following in your proposal: Your experience with Google Cloud Data Engineering or any cloud Examples of similar projects you've completed. Your weekly availability. Your preferred hourly rate. Must Share: Share your GitHub, portfolio/Resume, or any relevant project links.
Öppna på Upwork