Senior Data Engineer Azure Data Factory Developer (35968)

Original job posting

Design, develop, maintain, and optimize Databricks and Apache Spark data processing solutions, including ingestion and transformation workflows. Build and support Azure Data Factory pipelines and ETL integrations, troubleshoot and optimize execution, and assist with testing, deployment, documentation, and knowledge transfer.

Job details

Our client is seeking two Senior Data professionals to support a data engineering and integration initiative: one Data Engineer specializing in Databricks and Apache Spark, and one Azure Data Factory Developer focused on ETL and data integration. The engagement will include one onsite/hybrid resource in Toronto and one offshore resource, with both resources required to complete onboarding before the end of October 2026. Role 1: Senior Data Engineer, Databricks / Apache Spark Delivery Model: This role may be filled by either the onsite/hybrid Toronto resource or the offshore resource. Across the two positions, one resource will be onsite and one offshore. Responsibilities Design, develop and maintain data processing solutions using Databricks Develop and optimize Apache Spark jobs for data transformation and processing Build data ingestion and transformation workflows Develop scalable, reusable and unit-tested data engineering components Troubleshoot Databricks and Spark workloads Support deployment, issue resolution and enhancement activities Produce technical documentation and support knowledge transfer Required Skills Strong Databricks experience Strong Apache Spark experience Data transformation and processing Data ingestion and pipeline development Role 2: Senior Azure Data Factory Developer Delivery Model: This role may be filled by either the onsite/hybrid Toronto resource or the offshore resource. Across the two positions, one resource will be onsite and one offshore. Responsibilities Design, build and maintain Azure Data Factory pipelines and workflows Develop ETL and data integration solutions across source and target systems Support integrated processing and orchestration using Databricks where required Configure pipeline monitoring and error handling Troubleshoot and optimize data movement and pipeline execution Support testing, deployment and operational stabilization Produce technical documentation and support knowledge transfer Required Skills Strong Azure Data Factory experience Working knowledge of Databricks Data integration experience ETL pipeline development and support ,

What you’ll do

Design, develop, maintain, and optimize Databricks and Apache Spark data processing solutions, including ingestion and transformation workflows. Build and support Azure Data Factory pipelines and ETL integrations, troubleshoot and optimize execution, and assist with testing, deployment, documentation, and knowledge transfer.

Requirements

The Databricks-focused role requires strong Databricks and Apache Spark experience, along with data transformation, processing, ingestion, and pipeline development experience. The Azure Data Factory role requires strong Azure Data Factory experience, working knowledge of Databricks, and experience developing and supporting ETL pipelines and data integrations.

Listed skills

• Technical Documentation · Preferred
• Troubleshooting · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Databricks
• Apache Spark
• Azure Data Factory
• Data Transformation
• Data Processing
• Data Ingestion
• Data Pipeline Development
• ETL
• Data Integration
• Pipeline Monitoring
• Error Handling
• Troubleshooting
• Unit Testing
• Technical Documentation
• Knowledge Transfer

Job areas

• Data & Analytics
• Technology
• Software
• Manufacturing