Databricks Engineer
About the role
Sr. Databricks Engineer Location:- Toronto, ON (Hybrid Mode)
Job Summary: • We are seeking an experienced Engineer/Architect with 7 to 9 years of experience to join our team in a hybrid work model. • The ideal candidate will have expertise in PySpark and Azure Databricks, and will be responsible for designing and implementing data solutions. • This role requires a proactive individual who can drive innovation and efficiency in data processing and analytics.
Required Skills: Technical Skills: Databricks, PySpark, Azure • Responsibilities: - Design and develop scalable data architectures using PySpark and Azure Databricks to meet business requirements. – • Collaborate with cross-functional teams to understand data needs and translate them into technical solutions. • Implement data processing pipelines that ensure data quality, integrity, and security. • Optimize data workflows for performance and cost-effectiveness in a cloud environment. – • Provide technical guidance and mentorship to junior team members to foster growth and development. • Conduct regular reviews of data architecture and recommend improvements for efficiency. • Stay updated with the latest industry trends and technologies to ensure the company remains competitive. • Troubleshoot and resolve complex data-related issues to maintain system reliability. • Document data architecture designs and processes for future reference and compliance. • Engage with stakeholders to gather feedback and refine data solutions to better meet business objectives. • Ensure adherence to best practices and standards in data architecture and engineering. – • Contribute to the strategic planning of data initiatives to align with company goals. – • Drive innovation by exploring new tools and techniques to enhance data processing capabilities.
Qualifications: - • Possess a strong understanding of PySpark and its application in data processing. – • Demonstrate expertise in Azure Databricks and cloud-based data solutions. – • Have a proven track record of designing scalable data architectures. – • Show proficiency in optimizing data workflows for performance and cost. – • Exhibit excellent problem-solving skills and attention to detail. – • Display strong communication skills to effectively collaborate with teams. – • Hold a degree in Computer Science, Information Technology, or a related field.
Regards Sanjay Gupta Diverselynx LLC Tel: (732) 452-1006 Ext.317 Email ID : sanjay.gupta@diverselynx.com
Databricks Engineer
About the role
Sr. Databricks Engineer Location:- Toronto, ON (Hybrid Mode)
Job Summary: • We are seeking an experienced Engineer/Architect with 7 to 9 years of experience to join our team in a hybrid work model. • The ideal candidate will have expertise in PySpark and Azure Databricks, and will be responsible for designing and implementing data solutions. • This role requires a proactive individual who can drive innovation and efficiency in data processing and analytics.
Required Skills: Technical Skills: Databricks, PySpark, Azure • Responsibilities: - Design and develop scalable data architectures using PySpark and Azure Databricks to meet business requirements. – • Collaborate with cross-functional teams to understand data needs and translate them into technical solutions. • Implement data processing pipelines that ensure data quality, integrity, and security. • Optimize data workflows for performance and cost-effectiveness in a cloud environment. – • Provide technical guidance and mentorship to junior team members to foster growth and development. • Conduct regular reviews of data architecture and recommend improvements for efficiency. • Stay updated with the latest industry trends and technologies to ensure the company remains competitive. • Troubleshoot and resolve complex data-related issues to maintain system reliability. • Document data architecture designs and processes for future reference and compliance. • Engage with stakeholders to gather feedback and refine data solutions to better meet business objectives. • Ensure adherence to best practices and standards in data architecture and engineering. – • Contribute to the strategic planning of data initiatives to align with company goals. – • Drive innovation by exploring new tools and techniques to enhance data processing capabilities.
Qualifications: - • Possess a strong understanding of PySpark and its application in data processing. – • Demonstrate expertise in Azure Databricks and cloud-based data solutions. – • Have a proven track record of designing scalable data architectures. – • Show proficiency in optimizing data workflows for performance and cost. – • Exhibit excellent problem-solving skills and attention to detail. – • Display strong communication skills to effectively collaborate with teams. – • Hold a degree in Computer Science, Information Technology, or a related field.
Regards Sanjay Gupta Diverselynx LLC Tel: (732) 452-1006 Ext.317 Email ID : sanjay.gupta@diverselynx.com