Data Engineer
Költségvetés: -
HOURLY / PART_TIME
⭐ 5.00 (4)
USA
mongodb
Előnyben részesített képesítések
- Tapasztalat: Középhaladó
Job Description -Data Engineer
Job Summary
We are looking for an experienced Data Engineer with hands-on experience in Azure Databricks development, MongoDB, data cataloging, and data analytics. The ideal candidate should be comfortable working across multiple projects, handling data engineering workflows, and have a good understanding of AI-driven workflows and data solutions.
Key Responsibilities
Develop, build, and maintain scalable data pipelines using Azure Databricks.
Perform hands-on development using Databricks, PySpark, SQL, and Python.
Work with MongoDB for data storage, extraction, transformation, and integration.
Design and implement data ingestion, transformation, and processing workflows.
Work with data catalogs, metadata management, and data governance practices.
Collaborate with Data Analysts and business teams to understand data requirements and deliver analytical solutions.
Develop and support AI/ML data workflows and AI-enabled data processing solutions.
Manage and prioritize tasks across multiple projects simultaneously.
Troubleshoot data pipelines and ensure data quality, accuracy, and reliability.
Collaborate with cross-functional teams to translate business requirements into scalable data solutions.
Required Skills & Experience
2 years of hands-on experience in Azure Databricks development.
Strong hands-on experience with Azure Databricks and PySpark.
Good knowledge of Python and SQL.
Practical experience with MongoDB.
Experience with data cataloging, metadata, and data governance concepts.
Understanding of data analytics and data engineering processes.
Good exposure to AI workflows, AI/ML data pipelines, and AI-enabled applications.
Ability to independently manage and deliver work across multiple projects.
Strong problem-solving and analytical skills.
Good communication and collaboration skills.
Good to Have
Experience working in HR Tech / Human Resources domain.
Experience in the FinTech / Financial Services domain.
Exposure to Azure data services such as Azure Data Factory, Azure Synapse, Azure Data Lake, etc.
Experience with cloud-based data architecture and modern data platforms.
Understanding of data security, governance, and compliance.
Experience
Overall Experience: 3+ years in Data Engineering / related roles
Azure Databricks: 2 years of hands-on development experience
Ideal Candidate
The ideal candidate is a hands-on Data Engineer who can work independently, , build reliable data pipelines, and effectively collaborate with analytics, AI, and business teams.
Megnyitás Upworkön
AI proposal draft
Generate a short cover letter for this job. Edit before sending.
Sign in to generate an AI proposal draft.
Bejelentkezés