Databricks Architect | Canada

Job summary

Design and architect scalable Databricks-based solutions while leading end-to-end cloud data platform implementations. Serve as the primary technical point of contact for clients and provide leadership to data engineering teams.

Job details

About Cuesta Partners We are looking for a Databricks Architect to lead the delivery of data engineering solutions in a client-facing environment. This is a hands-on leadership role where you will work directly with clients — including C-level stakeholders — to design, build, and deploy production-grade Databricks platforms. What You’ll Do Design and architect scalable Databricks-based solutions for enterprise clients. Lead end-to-end cloud data platform implementations across AWS and/or Azure. Design and build production pipelines using Databricks Workflows and Spark Declarative Pipelines. Design scalable ETL/ELT pipelines using Spark, PySpark, and Databricks Workflows. Partner directly with client stakeholders to understand business needs and translate them into technical solutions. Provide technical leadership and guidance to data engineering teams. Implement CI/CD pipelines and infrastructure-as-code for Databricks resources. Drive collaborative development through Git workflows, pull requests, and code reviews. Collaborate cross-functionally with analytics, engineering, and business teams. Serve as the primary technical point of contact for clients, including C-level executives. What We’re Looking For 6+ years of experience in Data Engineering, Cloud Architecture, or related roles. 3+ years of hands-on experience with Databricks. Strong proficiency in PySpark, Spark SQL, Python, and SQL. Deep experience with Delta Lake, Unity Catalog, Delta Live Tables, and Databricks Jobs. Proven experience delivering Databricks projects in a consulting or professional services environment. Strong understanding of data lake concepts and formats (Delta, Iceberg, Parquet, etc.). Experience designing and managing Unity Catalog for governance, access control, and lineage. Familiarity with medallion architecture (bronze/silver/gold) patterns. Hands-on experience with Git version control, pull requests, code reviews, and collaborative development workflows. CI/CD and infrastructure-as-code for Databricks resources (Terraform, Asset Bundles, GitHub Actions). MLflow experience: experiment tracking, model registry, deployment, and observability. Cloud platform experience. Experience working in client-facing, consulting, or cross-functional environments. Experience leading technical projects or mentoring engineering teams. Nice to Have Databricks certifications (Data Engineer Associate or Professional, Machine Learning Associate or Professional, Data Engineer Associate or Professional or ML Engineer Associate or Professional). Experience with agentic AI workflows, including agents, skills, and tools on the Databricks side (Agentbricks), as well as LangChain and Claude agentic workflows. Benefits: What you’ll gain: At Cuesta, we value entrepreneurship, humility, diversity, learning, speed, and balance. We provide our team members with: Constant opportunities for exposure & learning Flexible working location and enabling personal-life harmony with work Agency and influence in the company’s total strategy and direction Collaboration with a high-performing team Competitive base salary (outlined in this listing) and target bonus of 15-25% 401k, healthcare benefits, paid time-off, and more!

What you’ll do

Design and architect scalable Databricks-based solutions while leading end-to-end cloud data platform implementations. Serve as the primary technical point of contact for clients and provide leadership to data engineering teams.

Requirements

Requires 6+ years of experience in data engineering or cloud architecture with at least 3 years of hands-on Databricks expertise. Proficiency in PySpark, SQL, and modern data lake patterns is essential for this consulting role.

Benefits

• Competitive base salary
• Annual bonus
• 401k
• Healthcare benefits
• Paid time-off
• Flexible working location

Listed skills

• SQL · Preferred
• CI/CD · Preferred
• Git · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Databricks
• Data Engineering
• Cloud Architecture
• PySpark
• Spark SQL
• Python
• SQL
• Delta Lake
• Unity Catalog
• Delta Live Tables
• ETL/ELT
• CI/CD
• Infrastructure-as-code
• Git
• MLflow
• Consulting
• Scalability Design
• Data Lakes
• Influencing Skills
• Agentic AI
• Pipelines
• Influencing Without Authority
• LangChain
• Pull/Merge Requests
• Apache Parquet
• Technical Projects
• Observability
• Workflow Management
• Time Off Management
• Git (Version Control System)
• Technical Leadership
• Machine Learning Model Monitoring And Evaluation
• Infrastructure as Code (IaC)
• Unity Engine
• C (Programming Language)
• Access Controls
• Amazon Web Services
• Microsoft Azure
• Cloud Computing Architecture
• Version Control
• Code Review
• Extract Transform Load (ETL)
• Github
• Governance
• Leadership
• Scalability
• Humility
• Python (Programming Language)
• Machine Learning
• Mentorship

Job areas

• Data & Analytics
• Technology
• Consulting
• Software
• Engineering
• Architect
• Data Architect
• Database Designers and Administrators
• Database Architects

More jobs from Cuesta Partners