Azure Databricks Architect

Toronto, ON
On-site
Posted Oct 20, 2026
1 position

Opens LinkedIn

Employment type: Contract
Experience level: Lead · 10+ years
Minimum education: Bachelor’s degree
Posting language: English
Working hours: 40 hours per week
Seniority: Mid-Senior level
Application method: Direct apply is available

Job summary

Design and deliver scalable Azure data architectures and Databricks-based engineering solutions, including REST API integrations and real-time pipelines using Kafka or message queues. Establish architecture and engineering best practices, troubleshoot complex issues, collaborate across teams, and mentor engineers.

Job details

Azure Databricks Architect Type: Long Term Contract Role Overview: We are seeking a Principal Azure Databricks Architect to design, architect, and deliver scalable, high-performance data solutions on Microsoft Azure. The ideal candidate will have strong hands-on expertise in Azure Databricks, ADLS, Java/Scala-based REST APIs, and Kafka/Messaging, along with the ability to provide technical leadership across data engineering initiatives. Key Responsibilities Design and implement scalable Azure data architectures using Azure Databricks and ADLS. Develop and integrate Java/Scala-based REST APIs for data and application services. Design and implement real-time data pipelines using Kafka and Message Queues (MQ). Lead Databricks-based data engineering and transformation solutions across enterprise environments. Define architecture standards, design patterns, security, performance, and scalability best practices. Collaborate with data engineers, application teams, architects, and business stakeholders. Troubleshoot complex data, integration, and performance issues. Provide technical guidance and mentorship to a small team of engineers. Must-Have Skills Strong experience with Azure Data Lake Storage (ADLS) Extensive hands-on experience with Azure Databricks Strong development experience with Java/Scala and REST APIs Hands-on experience with Kafka and/or Message Queues (MQ) Strong understanding of cloud-based data architecture and distributed data processing Experience designing scalable and highly available enterprise data solutions Good to Have Experience with Python APIs and scripting Experience leading or mentoring small technical teams Knowledge of Azure data services and modern data engineering practices Experience with CI/CD, DevOps, and infrastructure automation Education Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or a related field.

What you’ll do

Requirements

Requires extensive hands-on experience with Azure Databricks and ADLS, strong Java or Scala development and REST API experience, and experience with Kafka or message queues. Candidates should understand cloud data architecture and distributed processing and be able to design scalable, highly available enterprise solutions; a bachelor's or master's degree in a related field is specified.