About the role
Join Our Team as a Principal Databricks Data Engineer and Lead the Future of Enterprise Data Platforms
Are you a seasoned data architect with a passion for transforming legacy systems into innovative, scalable lakehouse solutions? We are seeking a visionary Principal Data Engineer specialized in Databricks to spearhead enterprise-wide data modernization initiatives. This is your opportunity to shape the future of finance and risk data platforms, influence strategic decision-making, and mentor the next generation of data engineering talent.
What You'll Do
Lead complex migrations from traditional Cloudera platforms to modern Databricks Lakehouse architectures, redesigning ingestion, transformation, and consumption patterns. Architect and govern enterprise data warehouses and data lakes, implementing layered structures for optimized analytics. Develop, optimize, and maintain large-scale data pipelines using PySpark, Spark SQL, and Delta Lake, ensuring high performance and reliability. Define and implement business metrics, data models, and semantic layers to support advanced reporting, analytics, and AI/ML workloads. Establish and enforce data governance, security, and compliance standards across cloud environments such as AWS or Azure. Collaborate with cross-functional teams including finance, risk, and analytics to deliver data solutions that drive business insight. Mentor senior engineers, champion best practices, and lead architectural decisions aligned with enterprise standards.
Required Skills
12–18 years of overall data engineering experience with a strong emphasis on enterprise Data Warehouse and Data Lake platforms. 8+ years of hands-on expertise in designing and implementing data solutions at scale. Minimum of 5 years working with Databricks and Spark, with proven success in modernization projects. Deep understanding of cloud-based data storage, Delta Lake, and SQL frameworks. Strong experience with modern data ingestion, transformation, and orchestration techniques. Proficiency in data governance, lineage, and security, ensuring compliance and data quality. Proven ability to act as a technical authority and lead cross-functional teams.
Nice To Have Skills
Experience in BFSI, capital markets, or regulatory reporting environments. Familiarity with SAP Finance, Oracle Financials, or S/4HANA. Exposure to supporting AI and ML workloads. Certifications such as Databricks Certified Data Engineer, cloud platform certifications, or related credentials. Knowledge of orchestration tools like Airflow or Databricks Workflows. Experience with CI/CD pipelines using Git, Terraform, Jenkins, or Azure DevOps. Familiarity with dbt or similar frameworks.
Preferred Education And Experience
Bachelor’s or Master’s degree in Computer Science, Data Science, or related field. Extensive experience in financial services, risk management, or related sectors.
Other Requirements
Willingness to collaborate with global teams and manage stakeholder relationships across finance, risk, and analytics functions. Ability to work in a fast-paced, dynamic environment with minimal supervision. Prior experience leading enterprise-wide data transformation initiatives is highly desirable.
Take the lead in redefining enterprise data architecture—apply now and become a pivotal part of a transformative journey that impacts some of the most critical financial and risk data environments. Your expertise will drive innovation and deliver measurable business impact!
Not the right fit? Search for Databricks Data Engineer jobs in Toronto, Ontario, Canada
About HRConnects
HRConnects is your complete resource for human resource management and recruitment services. We cater to organizations in various industries. From start-ups to Fortune 1000, we have provided custom-tailored solutions that fit our clients specific HR needs. Outsourcing your HR requirements to HRConnections will allow you to focus on and grow your own business, as only you know how.
Our dedicated staff combined with a pool of first rate talent allows us to meet your most challenging staffing needs, whether it be developing an HR department from the ground up or assisting a company experiencing rapid growth demand.
Working together with your hiring managers, our recruiters will develop and deploy effective recruitment strategies that produce the results you’re looking for fast. We have the expertise to assist in the management of a diverse range of hiring needs.
While our approach to each project is specifically tailored to deliver results, our commitment to reaching excellence is the same whether commencing an executive search or conducting a mass hiring campaign. The same commitment applies to clients both large and small.
HRConnections utilizes a recruitment methodology that is proven to locate and acquire the right talent in the shortest amount of time. Reaching exceptional talent first will only help to keep your organization ahead of the competition.
Similar Jobs
About the role
Join Our Team as a Principal Databricks Data Engineer and Lead the Future of Enterprise Data Platforms
Are you a seasoned data architect with a passion for transforming legacy systems into innovative, scalable lakehouse solutions? We are seeking a visionary Principal Data Engineer specialized in Databricks to spearhead enterprise-wide data modernization initiatives. This is your opportunity to shape the future of finance and risk data platforms, influence strategic decision-making, and mentor the next generation of data engineering talent.
What You'll Do
Lead complex migrations from traditional Cloudera platforms to modern Databricks Lakehouse architectures, redesigning ingestion, transformation, and consumption patterns. Architect and govern enterprise data warehouses and data lakes, implementing layered structures for optimized analytics. Develop, optimize, and maintain large-scale data pipelines using PySpark, Spark SQL, and Delta Lake, ensuring high performance and reliability. Define and implement business metrics, data models, and semantic layers to support advanced reporting, analytics, and AI/ML workloads. Establish and enforce data governance, security, and compliance standards across cloud environments such as AWS or Azure. Collaborate with cross-functional teams including finance, risk, and analytics to deliver data solutions that drive business insight. Mentor senior engineers, champion best practices, and lead architectural decisions aligned with enterprise standards.
Required Skills
12–18 years of overall data engineering experience with a strong emphasis on enterprise Data Warehouse and Data Lake platforms. 8+ years of hands-on expertise in designing and implementing data solutions at scale. Minimum of 5 years working with Databricks and Spark, with proven success in modernization projects. Deep understanding of cloud-based data storage, Delta Lake, and SQL frameworks. Strong experience with modern data ingestion, transformation, and orchestration techniques. Proficiency in data governance, lineage, and security, ensuring compliance and data quality. Proven ability to act as a technical authority and lead cross-functional teams.
Nice To Have Skills
Experience in BFSI, capital markets, or regulatory reporting environments. Familiarity with SAP Finance, Oracle Financials, or S/4HANA. Exposure to supporting AI and ML workloads. Certifications such as Databricks Certified Data Engineer, cloud platform certifications, or related credentials. Knowledge of orchestration tools like Airflow or Databricks Workflows. Experience with CI/CD pipelines using Git, Terraform, Jenkins, or Azure DevOps. Familiarity with dbt or similar frameworks.
Preferred Education And Experience
Bachelor’s or Master’s degree in Computer Science, Data Science, or related field. Extensive experience in financial services, risk management, or related sectors.
Other Requirements
Willingness to collaborate with global teams and manage stakeholder relationships across finance, risk, and analytics functions. Ability to work in a fast-paced, dynamic environment with minimal supervision. Prior experience leading enterprise-wide data transformation initiatives is highly desirable.
Take the lead in redefining enterprise data architecture—apply now and become a pivotal part of a transformative journey that impacts some of the most critical financial and risk data environments. Your expertise will drive innovation and deliver measurable business impact!
Not the right fit? Search for Databricks Data Engineer jobs in Toronto, Ontario, Canada
About HRConnects
HRConnects is your complete resource for human resource management and recruitment services. We cater to organizations in various industries. From start-ups to Fortune 1000, we have provided custom-tailored solutions that fit our clients specific HR needs. Outsourcing your HR requirements to HRConnections will allow you to focus on and grow your own business, as only you know how.
Our dedicated staff combined with a pool of first rate talent allows us to meet your most challenging staffing needs, whether it be developing an HR department from the ground up or assisting a company experiencing rapid growth demand.
Working together with your hiring managers, our recruiters will develop and deploy effective recruitment strategies that produce the results you’re looking for fast. We have the expertise to assist in the management of a diverse range of hiring needs.
While our approach to each project is specifically tailored to deliver results, our commitment to reaching excellence is the same whether commencing an executive search or conducting a mass hiring campaign. The same commitment applies to clients both large and small.
HRConnections utilizes a recruitment methodology that is proven to locate and acquire the right talent in the shortest amount of time. Reaching exceptional talent first will only help to keep your organization ahead of the competition.