Microsoft Azure Data Engineering Consultant

About United Delta United Delta is a leading digital transformation and emerging technologies consultancy specializing in AI, Data & Analytics, Intelligent Automation, Enterprise Integration, Low-Code Platforms, and Digital Solutions. We help governments and enterprises modernize their data platforms and unlock business value through cloud-native technologies. Position Overview We are seeking an experienced Microsoft Azure Data Engineering Consultant to design, develop, and implement modern enterprise data platforms using Microsoft Azure technologies. The consultant will play a key role in delivering end-to-end data integration, transformation, governance, analytics, and business intelligence solutions for our customers. The ideal candidate has strong expertise in Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Databricks, Microsoft Purview, Power BI, and Azure integration services. Key Responsibilities • Design and implement enterprise data platforms on Microsoft Azure. • Develop scalable ETL/ELT pipelines using Azure Data Factory (ADF). • Configure and manage ADF Connectors to integrate data from cloud, on-premises, SaaS, databases, APIs, and enterprise applications. • Design and implement data ingestion, transformation, cleansing, and orchestration workflows. • Develop data engineering solutions using Azure Databricks (PySpark, Spark SQL, Delta Lake, Genie). • Design and manage enterprise data lakes using Azure Data Lake Storage Gen2. • Implement modern data lakehouse architectures. • Configure and implement Microsoft Purview for data governance, cataloging, lineage, classification, and metadata management. • Develop interactive dashboards and executive reports using Microsoft Power BI. • Optimize data models for reporting and analytics. • Collaborate with business stakeholders to understand reporting and analytics requirements. • Design secure and scalable cloud architectures following Microsoft Azure best practices. • Implement CI/CD pipelines for Azure data solutions. • Monitor, troubleshoot, and optimize Azure data workloads. • Prepare technical documentation including architecture diagrams, solution designs, deployment guides, and operational runbooks. • Conduct knowledge transfer sessions and mentor customer technical teams. Required Technical Skills Microsoft Azure • Azure Data Factory (ADF) • Azure Data Factory Connectors • Azure Data Lake Storage Gen2 • Azure Databricks • Azure Synapse Analytics (preferred) • Azure SQL Database • Azure Blob Storage • Azure Key Vault • Azure Monitor • Azure DevOps Data Engineering • ETL / ELT Development • Data Modeling • Data Warehousing • Data Lakehouse Architecture • Data Integration • Data Quality • Data Transformation • Data Orchestration • Batch Processing • Incremental Data Loading Databricks • PySpark • Spark SQL • Delta Lake • Notebooks • Cluster Management • Performance Optimization • Genie Data Governance • Microsoft Purview • Data Catalog • Data Lineage • Metadata Management • Data Classification • Information Protection Business Intelligence • Microsoft Power BI • DAX • Power Query • Semantic Models • Dashboard Development • Report Optimization Programming Skills • Python • SQL • Spark SQL • PySpark • JSON • REST APIs Experience • 5+ years of experience in Data Engineering. • 3+ years of experience delivering Microsoft Azure Data Platform projects. • Hands-on experience implementing Azure Data Factory and Databricks solutions. • Experience building enterprise data lakes and modern analytics platforms. • Experience implementing Microsoft Purview is highly desirable. • Experience developing enterprise Power BI dashboards. • Experience integrating S/4 HANA RISE, Oracle DB 19C, MS SQL Server, Aveva PI Historian 2018 R3 SP6, Sharepoint Online (Office 365), SuccessFactors, IBM FileNet, Meridium 4.x, Primavera 19.x, Unisim Design Suite Honeywell, StarLLMs, Excel and other enterprise systems is an advantage. Preferred Certifications • Microsoft Certified: Azure Data Engineer Associate (DP-203) • Microsoft Certified: Azure Solutions Architect Expert • Microsoft Certified: Power BI Data Analyst Associate (PL-300) • Microsoft Certified: Azure Administrator Associate • Microsoft Certified: Fabric Analytics Engineer Associate (preferred) Soft Skills • Excellent analytical and problem-solving skills. • Strong communication and presentation skills. • Ability to engage with business and technical stakeholders. • Experience facilitating workshops and gathering requirements. • Strong documentation skills. • Ability to work independently and within multidisciplinary teams. • Customer-focused mindset with excellent consulting and advisory skills. Deliverables The consultant will be expected to deliver: • Azure Data Platform Architecture • Data Lake & Lakehouse Implementation • Azure Data Factory Pipelines • Azure Databricks Notebooks and Jobs • Data Integration Workflows • Microsoft Purview Configuration • Data Catalog & Governance Framework • Power BI Dashboards and Reports • CI/CD Pipelines • Technical Documentation • Knowledge Transfer and Training Preferred Industry Experience Experience delivering Azure Data Platform solutions within one or more of the following industries is highly desirable: • Oil & Gas • Manufacturing