Opens LinkedIn
- Employment type
- Full-time
- Experience level
- Senior · 5+ years
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Mid-Senior level
- Application method
- Direct apply is available
Job summary
Design, develop, and maintain scalable batch and streaming data pipelines using Azure Databricks, Delta Live Tables, and Databricks Workflows. Implement data quality checks, monitoring, alerting, troubleshooting, and performance optimization for data pipelines.
Job details
Advanced Data Engineer Canada (Remote) Full-time Must-Have Skills: Strong proficiency in Python, PySpark, and PyTest with solid software engineering best practices. Strong understanding of OOP concepts. Hands-on experience with Azure Databricks and Delta Live Tables (DLT). Experience designing, developing, and maintaining scalable batch and streaming data pipelines using Databricks Workflows. Strong knowledge of data architecture, data modeling, and ETL/ELT processes. Experience with Azure cloud services, including storage, compute, and security. Hands-on experience with Databricks Unity Catalog. Knowledge of workflow orchestration, pipeline monitoring, alerting, and troubleshooting. Experience implementing data quality checks, validation, and performance optimization. Strong understanding of Agile methodologies and collaborative development practices. Good to Have: GitHub Actions, CI/CD, and Datadog exposure.
What you’ll do
Design, develop, and maintain scalable batch and streaming data pipelines using Azure Databricks, Delta Live Tables, and Databricks Workflows. Implement data quality checks, monitoring, alerting, troubleshooting, and performance optimization for data pipelines.
Requirements
Requires strong Python, PySpark, and PyTest skills, software engineering practices, and knowledge of object-oriented programming, data architecture, data modeling, and ETL/ELT. Candidates should have hands-on experience with Azure Databricks, Unity Catalog, Azure cloud services, pipeline orchestration, and Agile collaboration; GitHub Actions, CI/CD, and Datadog are desirable.
Listed skills
- Python · Preferred
- CI/CD · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Python
- PySpark
- PyTest
- Object-Oriented Programming
- Azure Databricks
- Delta Live Tables
- Databricks Workflows
- Data Architecture
- Data Modeling
- ETL/ELT
- Azure Cloud Services
- Unity Catalog
- Workflow Orchestration
- Data Quality
- Agile Methodologies
- CI/CD
Job areas
- Data & Analytics
- Technology
- Software
More jobs from Quantum World Technologies Inc.
AI Lead
- On-site
- Toronto, ON
- Posted Oct 17, 2026
SAP SD OTC
- On-site
- Posted Oct 17, 2026
Clarity Developer
- On-site
- Toronto, ON
- Posted Oct 17, 2026
Workday Integration analyst
- On-site
- Toronto, ON
- Posted Oct 17, 2026
