Principal Data Engineer – Databricks
About the role
Position: Principal Data Engineer – Databricks Location: Toronto, ON (Onsite) Employment Type: Full-Time Total Experience: 10 + years
Job Summary: We are seeking an experienced Principal Data Engineer – Databricks to lead enterprise-scale data modernization initiatives, migrating legacy Cloudera platforms to the Databricks Lakehouse architecture. The ideal candidate will have deep expertise in Databricks, Spark, cloud data platforms, enterprise data warehousing, and finance/risk data domains.
Key Responsibilities: · Lead Cloudera (CDH/CDP) to Databricks Lakehouse migration projects. · Design scalable Data Lakehouse architectures using Medallion (Bronze, Silver, Gold) principles. · Develop and optimize PySpark, Spark SQL, Delta Lake, and Databricks SQL pipelines. · Modernize legacy Hive/Impala workloads into scalable ELT solutions. · Implement data governance, quality, lineage, security, and reconciliation frameworks. · Optimize Databricks performance using Delta Lake best practices. · Collaborate with Finance, Risk, Analytics, and Governance teams to deliver business-ready data solutions. · Mentor engineering teams and drive architecture, coding, and operational standards.
Required Skills: · 10+ years of Data Engineering experience. · Strong expertise in Databricks, Apache Spark, PySpark, Spark SQL, and Delta Lake. · Experience with Cloudera (CDH/CDP), Hive, HBase, Impala, and enterprise data modernization. · Strong knowledge of Data Warehouse, Data Lake/Lakehouse architecture, and cloud platforms (AWS/Azure). · Experience with CI/CD, Git, Terraform, Azure DevOps/Jenkins, and Airflow or Databricks Workflows. · Strong understanding of finance and risk data models. Preferred Qualifications: · Experience in BFSI/Capital Markets or Regulatory Reporting. · Exposure to SAP Finance, Oracle Financials, or S/4HANA. · Databricks or Cloud Certifications. · Experience supporting AI/ML workloads
Not the right fit? Search for Data Engineer jobs in Toronto, Ontario, Canada
About K&K Global Talent Solutions INC.
K&K Global Talents Solutions Inc: A New Era in the US Recruitment Industry With their partnership with a highly reputable German recruitment firm boasting over 30 years of experience, K&K Global Talents Solutions Inc. is an emerging player in the US recruitment industry. This collaboration allows them to merge the advantages of a new entrant with the vast knowledge and expertise of a well-established player. Clients and candidates are guaranteed to benefit from innovative recruitment approaches, cutting-edge strategies, and a wealth of knowledge and trust. K&K Global Talents represents the future of recruitment in both IT and Nursing industry, with a modern outlook and flexibility, combined with the methodologies that have sustained success for over 30 years, thanks to their esteemed German partner.
Similar Jobs
Principal Data Engineer – Databricks
About the role
Position: Principal Data Engineer – Databricks Location: Toronto, ON (Onsite) Employment Type: Full-Time Total Experience: 10 + years
Job Summary: We are seeking an experienced Principal Data Engineer – Databricks to lead enterprise-scale data modernization initiatives, migrating legacy Cloudera platforms to the Databricks Lakehouse architecture. The ideal candidate will have deep expertise in Databricks, Spark, cloud data platforms, enterprise data warehousing, and finance/risk data domains.
Key Responsibilities: · Lead Cloudera (CDH/CDP) to Databricks Lakehouse migration projects. · Design scalable Data Lakehouse architectures using Medallion (Bronze, Silver, Gold) principles. · Develop and optimize PySpark, Spark SQL, Delta Lake, and Databricks SQL pipelines. · Modernize legacy Hive/Impala workloads into scalable ELT solutions. · Implement data governance, quality, lineage, security, and reconciliation frameworks. · Optimize Databricks performance using Delta Lake best practices. · Collaborate with Finance, Risk, Analytics, and Governance teams to deliver business-ready data solutions. · Mentor engineering teams and drive architecture, coding, and operational standards.
Required Skills: · 10+ years of Data Engineering experience. · Strong expertise in Databricks, Apache Spark, PySpark, Spark SQL, and Delta Lake. · Experience with Cloudera (CDH/CDP), Hive, HBase, Impala, and enterprise data modernization. · Strong knowledge of Data Warehouse, Data Lake/Lakehouse architecture, and cloud platforms (AWS/Azure). · Experience with CI/CD, Git, Terraform, Azure DevOps/Jenkins, and Airflow or Databricks Workflows. · Strong understanding of finance and risk data models. Preferred Qualifications: · Experience in BFSI/Capital Markets or Regulatory Reporting. · Exposure to SAP Finance, Oracle Financials, or S/4HANA. · Databricks or Cloud Certifications. · Experience supporting AI/ML workloads
Not the right fit? Search for Data Engineer jobs in Toronto, Ontario, Canada
About K&K Global Talent Solutions INC.
K&K Global Talents Solutions Inc: A New Era in the US Recruitment Industry With their partnership with a highly reputable German recruitment firm boasting over 30 years of experience, K&K Global Talents Solutions Inc. is an emerging player in the US recruitment industry. This collaboration allows them to merge the advantages of a new entrant with the vast knowledge and expertise of a well-established player. Clients and candidates are guaranteed to benefit from innovative recruitment approaches, cutting-edge strategies, and a wealth of knowledge and trust. K&K Global Talents represents the future of recruitment in both IT and Nursing industry, with a modern outlook and flexibility, combined with the methodologies that have sustained success for over 30 years, thanks to their esteemed German partner.