Team Lead, Data Engineering - Databricks
About the role
Job Description About Citco: Since the 1940s, Citco has provided specialist financial services to alternative investment funds, investors, multinationals, and private clients worldwide. Our data engineering initiatives represent one of our most critical technical focus areas, driving innovation across our global operations.
About The Role As a Team Lead, you will lead a technical team of data engineers, ensuring best practices in performance, security, and scalability while working on Citco's enterprisewide Centralized Data Platform (CDP) built on Databricks.
This role requires a deep, hands-on understanding of Databricks internals and a track record of delivering large-scale data platforms in a cloud environment.
You'll be part of a team driving technical excellence and innovation within Citco's data engineering practice.
Responsibilities Your Role:
- You will lead and mentor a team of data engineers, conducting code reviews, design reviews, and knowledge-sharing sessions across multiple locations
- Drive the Agile/Scrum SDLC process and collaborate with team members
- Design and develop Databricks solutions leveraging Lakehouse architecture for enterprise data processing and analytics
- Develop and optimize ETL/ELT pipelines
- Create and manage structured streaming pipelines for real-time data processing
- Configure and optimize Databricks clusters and Spark jobs for optimal performance
- Utilize Delta Live Tables for data ingestion and transformations
- Apply Unity Catalog features and IAM best practices for security governance and access control
- Support infrastructure and resource management using Terraform
- Implement monitoring solutions for pipeline performance and data quality
- Contribute to code reviews and knowledge-sharing sessions
Qualifications Required Qualifications:
- 8+ years of experience in data engineering
- 3+ years of hands-on experience with Databricks platform
- Proven experience leading a team
- Strong expertise in Python and Spark programming
- Demonstrable experience in using AI in development
- Proven experience with AWS or other similar cloud services
- Deep understanding of data modeling and SQL
- Experience with Delta Lake and Lakehouse architecture
- Strong knowledge of ETL/ELT principles and patterns
- Experience with version control systems (Git)
- Demonstrated ability to optimize data pipelines
- Strong problem-solving and analytical skills
- Excellent communication and collaboration abilities
Nice To Have
- Financial services industry experience
- Experience with multiple cloud providers
- Knowledge of AI/ML implementation patterns
- API development experience
- Experience with real-time data processing
- Data governance framework experience
What Sets You Apart
- Active interest in emerging technologies and industry trends
- Experience implementing complex data solutions
- Track record of continuous learning and skill development
- Strong technical documentation abilities
- Experience using AI tools to enhance productivity
- Ability to mentor junior team members
Technical Environment
- Primary Platform: Databricks
- Cloud Platform: AWS (S3, Glue, Lambda)
- Languages: Python, SQL
- Tools: Delta Lake, Unity Catalog, Git
- Additional: Real-time processing, API integrations
Salary Range: CAD $135,000 - CAD $175,000
- This position is not for an existing vacancy; we are building a candidate pool for future opportunities.
Our Benefits Your well-being is of paramount importance to us, and central to our success. We provide a range of benefits, training and education support, and flexible working arrangements to help you achieve success in your career while balancing personal needs. Ask us about specific benefits in your location.
We embrace diversity, prioritizing the hiring of people from diverse backgrounds. Our inclusive culture is a source of pride and strength, fostering innovation and mutual respect.
itco welcomes and encourages applications from people with disabilities. Accommodation is available upon request for candidates taking part in all aspects of the selection.
About Citco
Our heritage, since founding a civil law notary practice in the 1940s to establishing the Curacao International Trust Company in the 1960s, is built on challenging paradigms and delivering exceptional service within the financial and professional services industry. Today, with more than 6,000 employees in 45 countries, we continue to pioneer award-winning services and technology solutions that meet ever changing markets.
A commitment to investing in people, and proprietary technologies, has resulted in our reputation as the industry's preeminent service provider, reassuring clients that their critical administration functions are in safe hands.
Our thought leadership and ability to quickly navigate complex change means our clients can depend on us as trusted advisors to make informed decisions in response to market conditions.
Our Divisions
Citco Fund Services & Investor Relations CFS is the global leader in services for the alternative investment industry. With over 2,000 funds under administration and net assets exceeding $840 billion, we provide full service fund administration, fund accounting, net asset value calculations, investor relations, and more.
Governance Services Leveraging our extensive global office network Citco Governance Services provides customised solutions, including corporate and global subsidiary governance, secretarial services, financial accounting and reporting, tax and audit liaison, and market entry services.
Banking, Depositary & Custody Services Citco Banks operate in strategic financial centres and provide Institutional and Fund of Funds clients access to the funds universe through multiple communication and online real-time global funds platforms.
Citco Technology Management Through our eight global development centres, Citco Technology Management provides secure infrastructures and develops award-winning technology products that underpin our commitment to service excellence.
Similar jobs you might like
Team Lead, Data Engineering - Databricks
About the role
Job Description About Citco: Since the 1940s, Citco has provided specialist financial services to alternative investment funds, investors, multinationals, and private clients worldwide. Our data engineering initiatives represent one of our most critical technical focus areas, driving innovation across our global operations.
About The Role As a Team Lead, you will lead a technical team of data engineers, ensuring best practices in performance, security, and scalability while working on Citco's enterprisewide Centralized Data Platform (CDP) built on Databricks.
This role requires a deep, hands-on understanding of Databricks internals and a track record of delivering large-scale data platforms in a cloud environment.
You'll be part of a team driving technical excellence and innovation within Citco's data engineering practice.
Responsibilities Your Role:
- You will lead and mentor a team of data engineers, conducting code reviews, design reviews, and knowledge-sharing sessions across multiple locations
- Drive the Agile/Scrum SDLC process and collaborate with team members
- Design and develop Databricks solutions leveraging Lakehouse architecture for enterprise data processing and analytics
- Develop and optimize ETL/ELT pipelines
- Create and manage structured streaming pipelines for real-time data processing
- Configure and optimize Databricks clusters and Spark jobs for optimal performance
- Utilize Delta Live Tables for data ingestion and transformations
- Apply Unity Catalog features and IAM best practices for security governance and access control
- Support infrastructure and resource management using Terraform
- Implement monitoring solutions for pipeline performance and data quality
- Contribute to code reviews and knowledge-sharing sessions
Qualifications Required Qualifications:
- 8+ years of experience in data engineering
- 3+ years of hands-on experience with Databricks platform
- Proven experience leading a team
- Strong expertise in Python and Spark programming
- Demonstrable experience in using AI in development
- Proven experience with AWS or other similar cloud services
- Deep understanding of data modeling and SQL
- Experience with Delta Lake and Lakehouse architecture
- Strong knowledge of ETL/ELT principles and patterns
- Experience with version control systems (Git)
- Demonstrated ability to optimize data pipelines
- Strong problem-solving and analytical skills
- Excellent communication and collaboration abilities
Nice To Have
- Financial services industry experience
- Experience with multiple cloud providers
- Knowledge of AI/ML implementation patterns
- API development experience
- Experience with real-time data processing
- Data governance framework experience
What Sets You Apart
- Active interest in emerging technologies and industry trends
- Experience implementing complex data solutions
- Track record of continuous learning and skill development
- Strong technical documentation abilities
- Experience using AI tools to enhance productivity
- Ability to mentor junior team members
Technical Environment
- Primary Platform: Databricks
- Cloud Platform: AWS (S3, Glue, Lambda)
- Languages: Python, SQL
- Tools: Delta Lake, Unity Catalog, Git
- Additional: Real-time processing, API integrations
Salary Range: CAD $135,000 - CAD $175,000
- This position is not for an existing vacancy; we are building a candidate pool for future opportunities.
Our Benefits Your well-being is of paramount importance to us, and central to our success. We provide a range of benefits, training and education support, and flexible working arrangements to help you achieve success in your career while balancing personal needs. Ask us about specific benefits in your location.
We embrace diversity, prioritizing the hiring of people from diverse backgrounds. Our inclusive culture is a source of pride and strength, fostering innovation and mutual respect.
itco welcomes and encourages applications from people with disabilities. Accommodation is available upon request for candidates taking part in all aspects of the selection.
About Citco
Our heritage, since founding a civil law notary practice in the 1940s to establishing the Curacao International Trust Company in the 1960s, is built on challenging paradigms and delivering exceptional service within the financial and professional services industry. Today, with more than 6,000 employees in 45 countries, we continue to pioneer award-winning services and technology solutions that meet ever changing markets.
A commitment to investing in people, and proprietary technologies, has resulted in our reputation as the industry's preeminent service provider, reassuring clients that their critical administration functions are in safe hands.
Our thought leadership and ability to quickly navigate complex change means our clients can depend on us as trusted advisors to make informed decisions in response to market conditions.
Our Divisions
Citco Fund Services & Investor Relations CFS is the global leader in services for the alternative investment industry. With over 2,000 funds under administration and net assets exceeding $840 billion, we provide full service fund administration, fund accounting, net asset value calculations, investor relations, and more.
Governance Services Leveraging our extensive global office network Citco Governance Services provides customised solutions, including corporate and global subsidiary governance, secretarial services, financial accounting and reporting, tax and audit liaison, and market entry services.
Banking, Depositary & Custody Services Citco Banks operate in strategic financial centres and provide Institutional and Fund of Funds clients access to the funds universe through multiple communication and online real-time global funds platforms.
Citco Technology Management Through our eight global development centres, Citco Technology Management provides secure infrastructures and develops award-winning technology products that underpin our commitment to service excellence.