Implement end-to-end data engineering solutions for business analytics on Microsoft Fabric

The Company: Dimensional Strategies Inc. (DSI), is a premier Microsoft partner located in the GTA, Ontario, Canada. Our customer base extends across Canada and the contiguous US states. DSI’s primary goal is to help our customers execute their business processes more efficiently and effectively via investments in applications and analytics. Core practices include – Cloud Infrastructure, Application Development, Data Engineering & Analytics, and Managed Services. The Position: Participate in the end-to-end execution and delivery of our data platform projects that focus on ingesting and curating data for analytical consumption. You will be using DSI's flagship in-house metadata-driven framework for Microsoft Fabric that is based on Medallion Lakehouse architecture. You will work with the DSI data engineering team and use data engineering specifications to create production-ready data pipelines across Bronze (ingestion), Silver (cleansing), and Gold (curation) layers. This is a hands-on delivery role - not architecture, not requirements gathering, not custom data engineering or data science. What You'll Do · Bootstrap and provision new customer environments in Microsoft Fabric · Author and maintain YAML-based pipeline configurations for all data layers · Deploy configurations and artifacts to Microsoft Fabric via CI/CD pipelines · Configure data ingestion from various data sources including REST API, file sources, and SQL databases · Define merge strategies, column transformations, and data quality rules · Validate pipeline outputs by running notebooks and verifying table data in Fabric · Debug pipeline failures using logs, tracing config errors to resolution · Manage multiple environments (dev, test, production) across customer projects · Collaborate with the DSI data engineers that define the specs for the solutions What You Won't Do · Gather requirements or collaborate with customers · Write or modify the data engineering specification · Perform custom data engineering or research in Microsoft Fabric · Perform business analysis · Design solution architecture from scratch Primary Qualifications · Multiple years of dedicated data engineering experience · Strong SQL skills with Spark SQL and T-SQL - window functions, CTEs, aggregations, CASE expressions · Experience with Lakehouse architecture in Microsoft Fabric including Delta tables, and semi-structured file formats · Solid understanding of Medallion architecture (Bronze/Silver/Gold) or equivalent layered data patterns · Experience with REST API integrations - authentication, pagination, JSON response handling · Familiarity with merge/upsert patterns (SCD Type-1, Type-2, overwrite, append) · Proficiency with Git - branching, pull requests, merge conflict resolution · Comfortable reading and authoring YAML configurations · Understanding of Apache Spark concepts — partitions, lazy evaluation, actions vs transforms Nice to have Qualifications · Exposure to CI/CD pipelines (Azure DevOps or GitHub Actions) · Basic Python reading ability (not writing production code, but can trace logic) · Familiarity with expression languages like Jinja2 · Experience with Python scripts execution · Experience with PowerShell scripts execution · KQL / Kusto query experience for log analysis · Databricks or Azure Synapse experience Work Environment · Fully remote with flexible time management · Initially supervised by DSI team members, progressing to semi-autonomous and then fully autonomous delivery responsibilities · Multi-customer project rotation · Work in a mature well-documented Microsoft/GitHub enterprise environment using established patterns and templates