Senior Data Engineer

MatchBox Consulting Group is currently seeking a Senior Data Engineer for a 6 month contract role with a client of ours located in Vancouver. This is a fully remote opportunity but the successful candidate will need to work based on PST time zone. Responsibilities Designing and implementing scalable data architectures (batch/streaming, Lakehouse) using Azure, Databricks, and PySpark Leading migrations from legacy systems to cloud-native platforms, ensuring minimal downtime and maximal performance Advocating for data mesh principles and dimensional modeling best practices Optimizing ETL/ELT workflows for structured and semi-structured data (e.g., Cosmos DB integrations) Establishing data quality frameworks, monitoring systems, and governance policies aligned with compliance standards Partnering with SecOps/FinOps teams to enforce security protocols and cost controls Mentoring junior engineers through code reviews, technical workshops, and hands-on guidance Leading cross-functional design reviews and backlog prioritization for critical initiatives Collaborating with data scientists to enable ML-ready datasets and real-time analytics Evaluating emerging tools (e.g., GenAI pipelines, real-time processing) and driving proof-of-concept projects Defining CI/CD workflows, infrastructure-as-code (Terraform), and SDLC best practices Must Have 5–8 years of experience in data engineering, and modern tools (Databricks, PySpark) Advanced SQL and Python skills, with hands-on experience in large-scale ETL/ELT, data lakes, and NoSQL databases (Cosmos DB) Experience mentoring teams, leading architecture reviews, and influencing technical roadmaps Nice To Have Strong knowledge of DevOps practices (CI/CD), data mesh concepts, and dimensional modeling Expertise in cloud platforms (Azure preferred) Unity experiences Proven track record in optimizing pipelines, implementing governance, and leading system migrations For more current job opportunities, Follow MatchBox at linkedin.com/company/matchbox-recruitment/ _________________________ About MatchBox Headquartered in downtown Vancouver and serving clients nationally, MatchBox is one of the leading recruitment and solutions firms that specializes in the fields of IT & Technology, Engineering & Technical, Real Estate & Construction, and Accounting & Finance. We offer unrivaled expertise with our team's extensive experience in the recruitment and professional services industry. We are dedicated to building great connections and creating strong opportunities within the workforce and the labor market. Equal Opportunities MatchBox is committed to providing equal opportunities for all applicants. We welcome and encourage applications from people of all backgrounds, including members of minority groups such as racialized individuals, people with disabilities, LGBTQ+ individuals, and Indigenous peoples. It is a priority for us that all candidates are treated fairly and without discrimination. Our recruitment teams receive ongoing training on using objective criteria for evaluating candidates and other related topics to create an inclusive and welcoming environment for all. Work Permits Please note that we require all interested candidates to obtain the necessary work permits from the Government of Canada prior to submitting an application. This position is open exclusively to individuals residing in Canada and legally authorized to work in Canada. Applications not meeting these criteria will not be considered. Further Consideration We receive a high volume of applications and are only able to contact candidates who are selected for further consideration. Find out more at www.matchboxhr.com

The role involves designing and implementing scalable data architectures using Azure, Databricks, and PySpark while leading migrations from legacy systems to cloud-native platforms. Additionally, the engineer will establish data quality frameworks, mentor junior staff, and collaborate with cross-functional teams to enable ML-ready datasets.

Candidates must have 5–8 years of experience in data engineering with proficiency in Databricks, PySpark, SQL, and Python. Strong expertise in large-scale ETL/ELT processes, NoSQL databases, and cloud-native architecture is required.

• Microsoft AzurePreferred
• SQLPreferred
• CI/CDPreferred
• TerraformPreferred
• PythonPreferred

Identified from the job description. Confirm important requirements above.

• Azure
• Databricks
• PySpark
• SQL
• Python
• ETL
• ELT
• Data lakes
• NoSQL
• Cosmos DB
• Data mesh
• Dimensional modeling
• Terraform
• CI/CD
• Infrastructure-as-code
• Governance

• Data & Analytics
• Technology
• Software
• Consulting
• Engineering

Minimum experience

5+ years

Apply by

Sep 10, 2026

Posting language

English

Working hours

40 hours per week

Seniority

Mid-Senior level

Application method

Direct apply is available