Intermediate Azure Databricks / PySpark Developer
Top Benefits
About the role
Role: Intermediate Azure Databricks / PySpark Developer
Contract: 12 months (with possible extension) Weekly Hours: 37.5 Location: Toronto, ON -Core on-site 5 days/month - every Monday, one Friday a month Compensation: $50-60/Hour Start date: Mid- End Sept Interview Process: 1st round: Panel - 30 mins virtual/ 2nd round: In-person (mandatory)- 30-60 mins
Must Haves
5+ years of hands-on experience in Databricks (including RBAC, permission, catalog management, governance) Design and develop scalable data pipelines using Azure Databricks, SCALA, Python, PySpark, and Delta Lake.
Have a good understanding of RDBMS and proficiency in writing complex SQL
Implement ETL/ELT workflows for structured, semi-structured, and unstructured data. Optimize performance of data processing and ensure data quality standards. Work with Azure Data Lake, Unity Catalogue, and integrate with CI/CD pipelines. (Unity Catalog preferred, if not Hive MetaStore or MetaData Management) Strong knowledge of Databricks technologies, specifically Delta Lake and Apache Spark, with a focus on implementing data engineering best practices. Working experience on a migration project.
Nice to Haves
Experience with orchestration tools like Airflow or Azure Data Factory
We may use AI-enabled and/or automated tools to support parts of our recruitment process, including application screening, interview scheduling, and candidate communications. These tools are used to enhance consistency and efficiency. All hiring decisions involve human review and are not based solely on automated processing.
The Company offers a total rewards package in accordance with all applicable federal, provincial, and local laws and requirements. Benefit eligibility and offerings vary based on role, employment status, and work location. For contractor positions, benefits are limited to those entitlements and protections required by applicable law, which may include (as applicable) vacation pay, public holidays, leaves of absence, and other legally mandated benefits or payments.
About Collabera
In our relentless pursuit of greatness, we are dedicated to developing individuals, creating exceptional teams, and cultivating a unique culture of unity and care. As providers of digital talent solutions, we aim to positively impact businesses and communities globally. We would be honored to be your trusted and uncommon partner on this journey.
Similar Jobs
Intermediate Azure Databricks / PySpark Developer
Top Benefits
About the role
Role: Intermediate Azure Databricks / PySpark Developer
Contract: 12 months (with possible extension) Weekly Hours: 37.5 Location: Toronto, ON -Core on-site 5 days/month - every Monday, one Friday a month Compensation: $50-60/Hour Start date: Mid- End Sept Interview Process: 1st round: Panel - 30 mins virtual/ 2nd round: In-person (mandatory)- 30-60 mins
Must Haves
5+ years of hands-on experience in Databricks (including RBAC, permission, catalog management, governance) Design and develop scalable data pipelines using Azure Databricks, SCALA, Python, PySpark, and Delta Lake.
Have a good understanding of RDBMS and proficiency in writing complex SQL
Implement ETL/ELT workflows for structured, semi-structured, and unstructured data. Optimize performance of data processing and ensure data quality standards. Work with Azure Data Lake, Unity Catalogue, and integrate with CI/CD pipelines. (Unity Catalog preferred, if not Hive MetaStore or MetaData Management) Strong knowledge of Databricks technologies, specifically Delta Lake and Apache Spark, with a focus on implementing data engineering best practices. Working experience on a migration project.
Nice to Haves
Experience with orchestration tools like Airflow or Azure Data Factory
We may use AI-enabled and/or automated tools to support parts of our recruitment process, including application screening, interview scheduling, and candidate communications. These tools are used to enhance consistency and efficiency. All hiring decisions involve human review and are not based solely on automated processing.
The Company offers a total rewards package in accordance with all applicable federal, provincial, and local laws and requirements. Benefit eligibility and offerings vary based on role, employment status, and work location. For contractor positions, benefits are limited to those entitlements and protections required by applicable law, which may include (as applicable) vacation pay, public holidays, leaves of absence, and other legally mandated benefits or payments.
About Collabera
In our relentless pursuit of greatness, we are dedicated to developing individuals, creating exceptional teams, and cultivating a unique culture of unity and care. As providers of digital talent solutions, we aim to positively impact businesses and communities globally. We would be honored to be your trusted and uncommon partner on this journey.