Data Engineer
Orçamento: -
HOURLY / PART_TIME
⭐ 0.00 (0)
Canada
sql-azure, business-intelligence, microsoft-power-bi-data-visualization, microsoft-power-bi, sql, microsoft-sql-ssas, ssis, etl-pipelines, data-modeling, windows-azure
Data Engineer Job Description
Job Title: Data Engineer
Job Summary
We are seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines and infrastructure that support business intelligence, analytics, and data science initiatives. The ideal candidate will have strong experience with databases, ETL/ELT processes, cloud platforms, and big data technologies.
Key Responsibilities
Design, build, and maintain robust data pipelines for ingesting, processing, and transforming data from multiple sources.
Develop and optimize ETL/ELT workflows to ensure efficient data movement and integration.
Create and manage data warehouses, data lakes, and other storage solutions.
Ensure data quality, consistency, security, and governance across systems.
Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements.
Monitor and troubleshoot data pipeline performance and resolve data-related issues.
Implement automation and orchestration for data workflows.
Optimize database performance and data architecture for scalability and reliability.
Document data processes, models, and system architectures.
Required Qualifications
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
2+ years of experience in data engineering, database development, or a related role.
Strong proficiency in SQL and Python.
Experience with ETL/ELT tools and data integration techniques.
Knowledge of relational and non-relational databases.
Familiarity with cloud platforms (AWS, Azure, or Google Cloud).
Understanding of data modeling, data warehousing, and data governance principles.
Experience with version control systems such as Git.
Preferred Qualifications
Experience with big data technologies such as Apache Spark or Hadoop.
Knowledge of workflow orchestration tools such as Airflow.
Experience with cloud data warehouses such as Snowflake, BigQuery, or Redshift.
Familiarity with CI/CD practices and DevOps concepts.
Relevant cloud or data engineering certifications.
Technical Skills
SQL
Python
Data Modeling
ETL/ELT Development
Data Warehousing
Cloud Computing
Apache Spark
Airflow
Git
Database Administration
Soft Skills
Strong analytical and problem-solving abilities
Excellent communication and collaboration skills
Attention to detail
Time management and organizational skills
Ability to work independently and in team environments
Sample Resume Keyword List
Data Engineering, SQL, Python, ETL, ELT, Data Pipelines, Data Warehouse, Data Lake, Spark, Hadoop, Airflow, AWS, Azure, GCP, Snowflake, BigQuery, Redshift, Data Modeling, Data Governance, Automation, CI/CD.
If you're applying for a specific level (Junior, Mid-Level, Senior, or Lead Data Engineer), I can tailor the job description accordingly.
Abrir na Upwork