← Trabalhos

Data Engineer Needed for ETL Pipeline Development

Orçamento: $500.0 FIXED / ⭐ 5.00 (312) United States

hadoop, apache-spark, sas, sap

We are looking for a Data Engineer to help us build a reliable ETL pipeline that extracts data from our source system, transforms it into a clean and structured format, and loads it into our database or data warehouse. The goal of this project is to automate our data flow, reduce manual work, and make the data ready for reporting and analysis. Responsibilities: * Extract data from APIs, databases, CSV files, or other provided sources * Clean, transform, and validate the data * Build an automated ETL pipeline using Python, SQL, or any recommended tool * Load the processed data into a database or data warehouse * Add basic logging and error handling * Document the pipeline setup and provide clear instructions for future use Required Skills: * Strong experience with Python and SQL * Experience building ETL or ELT pipelines * Familiarity with APIs, CSV/Excel files, relational databases, or cloud storage * Ability to write clean, reusable, and well-documented code * Basic understanding of data quality checks and pipeline automation Nice to Have: * Experience with Airflow, dbt, AWS, GCP, Azure, BigQuery, Snowflake, or Redshift * Experience creating data models for dashboards or reporting * Experience working with business or SaaS data Deliverables: * Working ETL pipeline * Clean transformed dataset loaded into the target system * Basic error handling and logging * Documentation explaining how to run and maintain the pipeline Ideal Candidate: The ideal candidate has hands-on experience building practical data pipelines and can complete the project independently with clear communication. Please apply with examples of similar ETL/data pipeline work you have completed.
Abrir na Upwork