Senior Data Engineer

Hiring: Senior Data Engineer Location: Edmonton, Alberta, Remote (3-4 onsite meetings per year) Duration: September 1, 2026 – August 31, 2027 Hourly Rate: $85/hour - $105/hour (based on experience) Client: Public Sector Responsibilities: Collaborate with business stakeholders and product owners to understand data product objectives, requirements, and success criteria Design and implement scalable, secure, and high-performance data architecture on Microsoft Azure, supporting both cloud-native and hybrid environments. Lead the development of data ingestion, transformation, and integration pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. Work with the Data Architect and manage data lakes and structured storage solutions using Azure Data Lake Storage Gen2, ensuring efficient access and governance. Integrate data from diverse source systems including ServiceNow, and geospatial systems, using APIs, connectors, and custom scripts. Develop and maintain robust data models and semantic layers to support operational reporting, analytics, and machine learning use cases and downstream consumption. Build and optimize data workflows using Python and SQL for data cleansing, enrichment, and advanced analytics within Azure Databricks. Design and expose secure data services and APIs using Azure API Management for downstream systems. Implement data governance practices, including metadata management, data classification, and lineage tracking. Ensure compliance with privacy and regulatory standards (e.g., FOIP, GDPR) through role-based access controls, encryption, and data masking. Monitor and troubleshoot data pipelines and integrations, ensuring reliability, scalability, and performance across the platform. Utilize AI and automation tools to streamline data engineering workflows, including pipeline development, testing, monitoring, and documentation. Leverage AI-assisted tools for code generation, optimization, and review to improve development efficiency and code quality. Design and curate standardized, high‑quality datasets that are suitable for advanced analytics and future AI use cases. Other duties as needed Must Haves: (Certifications are highly preferred) Post-Secondary degree, diploma or certificate in Computer Science or related field of study. Minimum 3 years’ experience designing data solutions for analytics-ready, trusted datasets using tools like Power BI and Synapse, including semantic layers, data marts, and data products for self-service, data science, and reporting Minimum 4 years’ experience in Github/Git for version control, collaborative development, code management, and integration with data engineering workflows. Minimum 3 years’ experience with Azure services (Storage, SQL, Synapse, networking) for scalable, secure solutions, and with authentication (Service Principals, Managed Identities) for secure access in pipelines and integrations. Minimum 5 years’ experience in Python (including PySpark) and SQL, applied to developing, orchestrating, and optimizing enterprise-grade ETL/ELT workflows in a large-scale cloud environment. Minimum 3 years’ experience building scalable data pipelines with Azure Databricks, Delta Lake, Workflows, Jobs, and Notebooks, plus cluster management. Extending solutions to Synapse Analytics and Microsoft Fabric is a plus. Minimum 1 year experience using AI-Experienced in using AI for code generation, data analysis, automation, and enhancing productivity in data engineering workflows. Nice to have: Minimum 6 years direct, hands-on experience performing business requirement analysis related to data manipulation/transformation, cleansing and wrangling. Minimum 6 years’ experience and strong technical knowledge of Microsoft SQL Server, including database design, optimization, and administration in enterprise environments. Minimum 2 years’ experience extending or integrating data solutions with Azure Synapse Analytics and Microsoft Fabric (Lakehouse, Warehouse, Semantic Models). Minimum 1-year direct experience building data products in Government of Alberta cloud environment. Minimum 3 years’ experience in building secure, scalable RESTful APIs for data exchange, with robust auth, error handling, and support for real-time automation. Minimum 3 years’ experience in Message Queueing Technologies, implementing message queuing using tools like ActiveMQ and Service Bus for scalable, asynchronous communication across distributed systems. Minimum 5 years’ experience working with cross-functional teams to create software applications and data products. We appreciate all interest; however, only candidates whose experience fully meets the posted requirements will be considered. Interested? If you meet the above criteria apply now! **AI is not being used in the application/recruitment process for this position**

Design and implement scalable data architectures and ingestion pipelines on Microsoft Azure to support analytics and machine learning. Collaborate with stakeholders to develop secure data services, governance practices, and AI-driven workflows for public sector data products.

Requires a degree in Computer Science and at least 5 years of experience in Python and SQL for enterprise ETL workflows. Candidates must have 3+ years of experience with Azure services, Databricks, and version control using Git.

• PythonPreferred
• SQLPreferred
• GitHubPreferred
• Power BIPreferred

Identified from the job description. Confirm important requirements above.

• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Python
• SQL
• PySpark
• Delta Lake
• Azure Data Lake Storage Gen2
• Github
• Power BI
• RESTful APIs
• Data Modeling
• ETL/ELT Workflows
• Data Governance
• Microsoft Fabric
• AI-assisted development

• Data & Analytics
• Technology
• Government & Public Sector
• Software
• Engineering

Minimum education

Professional degree

Minimum experience

5+ years

Apply by

Sep 10, 2026

Posting language

English

Working hours

40 hours per week

Location requirements

Country, Edmonton, Alberta, Canada

Seniority

Mid-Senior level

Application method

Direct apply is available