Senior Databricks Engineer
The role involves designing and executing the migration of Unity Catalog assets onto an enterprise AI platform for a Canadian bank. Responsibilities include implementing access patterns, developing testable Python code, and integrating pipelines into automated CI/CD workflows.
- On-site
- Toronto, ON
- Posted Aug 24, 2026
- Apply by Feb 20, 2027
- 1 position
More jobs you can apply to directly
Similar opportunities posted by employers hiring on Jobs.ca, with no external application form.
Forgeahead Solutions Corporation
Technical Lead and Senior Software Engineer
- On-site
BC Public Schools
Manager, People, Performance and Culture
- On-site
Alcohol and Gaming Commission of Ontario (AGCO)
Information Management Lead / Responsable de la gestion de l’information
- On-site
Job summary
We are seeking a Senior Databricks Engineer to support a high-priority, fast-tracked platform enablement initiative for a premier Canadian banking client. This role focuses on early-phase design, exploratory architecture, and moving Unity Catalog assets onto an enterprise AI platform in a regulated environment. Key Responsibilities Build and execute the underlying logic to migrate Unity Catalog assets (catalogs, schemas, data, views, and materialized views) onto the central enterprise AI platform. Design and implement access patterns, Active Directory (AD) / Entra ID groups, and governance framework logic for business unit users. Develop robust, testable Python code using pytest following standard software engineering best practices. Execute a Proof of Concept (PoC) migrating initial pilot datasets to staging environments, laying the foundation for scaling to 100+ datasets. Integrate data platform pipelines into automated CI/CD workflows using GitHub and Jenkins. Required Qualifications Tech Stack: Advanced proficiency in Python, Databricks (specifically Unity Catalog & Delta Lake), and cloud infrastructure. Engineering Standards: Hands-on experience with unit testing (pytest), version control (GitHub), and automated build pipelines (Jenkins CI/CD). Domain Experience: Prior experience delivering data platform or cloud engineering solutions within Canadian Tier-1 banking or capital markets. Platform & Infrastructure: Familiarity with cloud/ML platform orchestration, access control models, and containerized environments (Kubernetes/K8s exposure). Location & Presence: Must be available to work on-site in Downtown Toronto. Nice to Have Experience with MLOps frameworks, model governance, and catalog migrations at scale. Prior consulting experience within major professional services or enterprise IT environments.
What you’ll do
The role involves designing and executing the migration of Unity Catalog assets onto an enterprise AI platform for a Canadian bank. Responsibilities include implementing access patterns, developing testable Python code, and integrating pipelines into automated CI/CD workflows.
Requirements
Candidates must have advanced proficiency in Python, Databricks, and cloud infrastructure, with a strong background in unit testing and version control. Prior experience delivering data platform solutions within Canadian Tier-1 banking or capital markets is required.
Listed skills
- KubernetesPreferred
- GitHubPreferred
- CI/CDPreferred
- PythonPreferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Python
- Databricks
- Unity Catalog
- Delta Lake
- Pytest
- GitHub
- Jenkins
- CI/CD
- Kubernetes
- Entra ID
- Cloud Infrastructure
- MLOps
- Data Migration
- Access Control Models
- Governance Frameworks
- Software Engineering
Job areas
- Data & Analytics
- Software
- Engineering
- Technology
- Consulting
Additional details
- Minimum experience
- 5+ years
- Apply by
- Feb 20, 2027
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Mid-Senior level
- Application method
- Direct apply is available