Senior Data Engineer
Rozpočet: $25.0 - $40.0
HOURLY / FULL_TIME
⭐ 5.00 (1)
United Arab Emirates
hadoop, etl-pipelines, data-source-integration, sas, sap, computer-networking
Preferované kvalifikace
- Zkušenost: Středně pokročilý
Senior Data Engineer – Snowflake, Airflow & AWS
We are looking for an experienced Data Engineer to design, build, and maintain scalable data pipelines and modern data warehouse solutions.
The ideal candidate should have strong hands-on experience with Snowflake, Apache Airflow, AWS, and Amazon Redshift, along with excellent Python and SQL skills.
Responsibilities
* Design and develop scalable ETL/ELT data pipelines
* Build and maintain workflows using Apache Airflow
* Develop data warehouse solutions using Snowflake and Amazon Redshift
* Work with AWS services including S3, Glue, Lambda, and related data services
* Develop optimized and maintainable Python and SQL code
* Implement data ingestion from APIs, databases, files, and third-party platforms
* Perform data transformation, cleansing, validation, and quality checks
* Optimize queries, pipelines, and warehouse performance
* Implement monitoring, logging, error handling, and pipeline alerting
* Work closely with analysts, data scientists, and engineering teams
* Follow best practices for security, scalability, documentation, and CI/CD
Requirements
* 4+ years of professional Data Engineering experience
* Strong experience with Snowflake
* Strong hands-on experience with Apache Airflow
* Experience with AWS data services
* Experience with Amazon Redshift
* Advanced SQL skills
* Strong Python programming skills
* Experience building production-grade ETL/ELT pipelines
* Solid understanding of data warehousing and dimensional data modeling
* Experience working with large datasets and performance optimization
* Familiarity with Git and CI/CD workflows
Nice to Have
* Experience with dbt
* AWS Glue experience
* Terraform or Infrastructure as Code
* Docker
* Kafka or other streaming technologies
* Experience migrating workloads from Redshift to Snowflake
* Experience with data quality frameworks and observability tools
What We're Looking For
We need someone who can own data engineering work end-to-end, not just execute individual tasks. You should be comfortable understanding business requirements, designing the data architecture, implementing pipelines, troubleshooting production issues, and optimizing existing systems.
Please include examples of Snowflake/Airflow/AWS data pipelines you have built, along with your availability and hourly rate.
Otevřít na Upwork
AI proposal draft
Generate a short cover letter for this job. Edit before sending.
Sign in to generate an AI proposal draft.
Přihlásit