← Livefeed

Senior Data Engineer

Budget: $25.0 - $40.0 HOURLY / FULL_TIME ⭐ 5.00 (1) United Arab Emirates

hadoop, etl-pipelines, data-source-integration, sas, sap, computer-networking

Gewenste kwalificaties

  • Ervaring: Gevorderd
Senior Data Engineer – Snowflake, Airflow & AWS We are looking for an experienced Data Engineer to design, build, and maintain scalable data pipelines and modern data warehouse solutions. The ideal candidate should have strong hands-on experience with Snowflake, Apache Airflow, AWS, and Amazon Redshift, along with excellent Python and SQL skills. Responsibilities * Design and develop scalable ETL/ELT data pipelines * Build and maintain workflows using Apache Airflow * Develop data warehouse solutions using Snowflake and Amazon Redshift * Work with AWS services including S3, Glue, Lambda, and related data services * Develop optimized and maintainable Python and SQL code * Implement data ingestion from APIs, databases, files, and third-party platforms * Perform data transformation, cleansing, validation, and quality checks * Optimize queries, pipelines, and warehouse performance * Implement monitoring, logging, error handling, and pipeline alerting * Work closely with analysts, data scientists, and engineering teams * Follow best practices for security, scalability, documentation, and CI/CD Requirements * 4+ years of professional Data Engineering experience * Strong experience with Snowflake * Strong hands-on experience with Apache Airflow * Experience with AWS data services * Experience with Amazon Redshift * Advanced SQL skills * Strong Python programming skills * Experience building production-grade ETL/ELT pipelines * Solid understanding of data warehousing and dimensional data modeling * Experience working with large datasets and performance optimization * Familiarity with Git and CI/CD workflows Nice to Have * Experience with dbt * AWS Glue experience * Terraform or Infrastructure as Code * Docker * Kafka or other streaming technologies * Experience migrating workloads from Redshift to Snowflake * Experience with data quality frameworks and observability tools What We're Looking For We need someone who can own data engineering work end-to-end, not just execute individual tasks. You should be comfortable understanding business requirements, designing the data architecture, implementing pipelines, troubleshooting production issues, and optimizing existing systems. Please include examples of Snowflake/Airflow/AWS data pipelines you have built, along with your availability and hourly rate.
Openen op Upwork

AI proposal draft

Generate a short cover letter for this job. Edit before sending.

Sign in to generate an AI proposal draft.

Inloggen