Manager, Data Engineering
Top Benefits
About the role
Job Description
What is the opportunity?
We are seeking a talented Data Engineer to join the Operational Data, Information, and AI team in Personal and Commercial Operations. The candidate will play a critical role in the design, implementation, and optimization of our cloud data lakehouse. You'll work with cutting-edge technologies to design, develop, and optimize scalable data pipelines that handle large volumes of structured and unstructured data and serve as the data foundation for transformational Business Intelligence, Machine Learning, and AI initiatives.
What will you do?
- Build and maintain data pipelines: Design, develop, and optimize robust ELT pipelines using technologies such as Snowflake, Airflow, and Spark to process large-scale datasets
- Migrate legacy data pipelines: Leverage LLMs to simplify the migration of existing data pipelines from legacy platforms such as our Unix, SQL Server, SAS, Hadoop, and Datameer to Snowflake.
- Monitoring and maintenance: Implement comprehensive monitoring, logging, and alerting for data pipelines; troubleshoot issues and ensure high availability of data systems
- Data quality and governance: Implement data validation, quality checks, and governance practices to ensure data integrity and compliance with enterprise policy
- Collaboration: Work in Agile squads with product owners, data scientists, BI developers, and engineers to deliver data solutions within agile frameworks.
What you need to succeed
Must-Haves
- 2+ years of experience in Data Engineering roles
- Strong programming skills in Python and SQL with experience in shell scripting and Unix environments
- Database expertise working with relational databases and data warehouses
- Data pipeline expertise with technologies such as Apache Spark, Airflow, or similar orchestration tools
- Experience with cloud platforms and version control systems
- Problem-solving mindset with attention to detail and ability to troubleshoot data issues
- Eagerness to learn new technologies and data engineering best practices
- Communication skills to work effectively with technical and business stakeholders
Nice-to-Haves
- Experience with Snowflake or completion of Snowflake certification
- Understanding of data governance frameworks, data quality monitoring practices, and data lineage tracking for enterprise data management
- Experience with Unix/Linux system maintenance and troubleshooting in enterprise environments.
- Containerization experience with Docker and enterprise container platforms
- Experience with LLM-based applications, vector databases, or GenAI frameworks
- Familiarity with prompt engineering, optimization, etc.
- Knowledge of machine learning deployment pipelines, model versioning, automated testing, and deployment automation frameworks.
What’s in it for you?
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
- A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions and stocks where applicable.
- Leaders who support your development through coaching and managing opportunities.
- Ability to make a difference and lasting impact.
- Work in a dynamic, collaborative, progressive and high-performing teams
- Opportunities to take on progressively greater accountabilities
About RBC
Royal Bank of Canada is a global financial institution with a purpose-driven, principles-led approach to delivering leading performance. Our success comes from the 94,000+ employees who leverage their imaginations and insights to bring our vision, values and strategy to life so we can help our clients thrive and communities prosper. As Canada's biggest bank and one of the largest in the world, based on market capitalization, we have a diversified business model with a focus on innovation and providing exceptional experiences to our more than 17 million clients in Canada, the U.S. and 27 other countries. Learn more at rbc.com. We are proud to support a broad range of community initiatives through donations, community investments and employee volunteer activities. See how at www.rbc.com/community-social-impact.
La Banque Royale du Canada est une institution financière mondiale définie par sa raison d'être, guidée par des principes et orientée vers l'excellence en matière de rendement. Notre succès est attribuable aux quelque 94 000+ employés qui mettent à profit leur créativité et leur savoir faire pour concrétiser notre vision, nos valeurs et notre stratégie afin que nous puissions contribuer à la prospérité de nos clients et au dynamisme des collectivités. Selon la capitalisation boursière, nous sommes la plus importante banque du Canada et l'une des plus grandes banques du monde. Nous avons adopté un modèle d'affaires diversifié axé sur l'innovation et l'offre d'expériences exceptionnelles à nos plus de 17 millions de clients au Canada, aux États Unis et dans 27 autres pays. Pour en savoir plus, visitez le site rbc.com/francais
Nous sommes fiers d'appuyer une grande diversité d'initiatives communautaires par des dons, des investissements dans la collectivité et le travail bénévole de nos employés. Pour de plus amples renseignements, visitez le site www.rbc.com/collectivite-impact-social.
Manager, Data Engineering
Top Benefits
About the role
Job Description
What is the opportunity?
We are seeking a talented Data Engineer to join the Operational Data, Information, and AI team in Personal and Commercial Operations. The candidate will play a critical role in the design, implementation, and optimization of our cloud data lakehouse. You'll work with cutting-edge technologies to design, develop, and optimize scalable data pipelines that handle large volumes of structured and unstructured data and serve as the data foundation for transformational Business Intelligence, Machine Learning, and AI initiatives.
What will you do?
- Build and maintain data pipelines: Design, develop, and optimize robust ELT pipelines using technologies such as Snowflake, Airflow, and Spark to process large-scale datasets
- Migrate legacy data pipelines: Leverage LLMs to simplify the migration of existing data pipelines from legacy platforms such as our Unix, SQL Server, SAS, Hadoop, and Datameer to Snowflake.
- Monitoring and maintenance: Implement comprehensive monitoring, logging, and alerting for data pipelines; troubleshoot issues and ensure high availability of data systems
- Data quality and governance: Implement data validation, quality checks, and governance practices to ensure data integrity and compliance with enterprise policy
- Collaboration: Work in Agile squads with product owners, data scientists, BI developers, and engineers to deliver data solutions within agile frameworks.
What you need to succeed
Must-Haves
- 2+ years of experience in Data Engineering roles
- Strong programming skills in Python and SQL with experience in shell scripting and Unix environments
- Database expertise working with relational databases and data warehouses
- Data pipeline expertise with technologies such as Apache Spark, Airflow, or similar orchestration tools
- Experience with cloud platforms and version control systems
- Problem-solving mindset with attention to detail and ability to troubleshoot data issues
- Eagerness to learn new technologies and data engineering best practices
- Communication skills to work effectively with technical and business stakeholders
Nice-to-Haves
- Experience with Snowflake or completion of Snowflake certification
- Understanding of data governance frameworks, data quality monitoring practices, and data lineage tracking for enterprise data management
- Experience with Unix/Linux system maintenance and troubleshooting in enterprise environments.
- Containerization experience with Docker and enterprise container platforms
- Experience with LLM-based applications, vector databases, or GenAI frameworks
- Familiarity with prompt engineering, optimization, etc.
- Knowledge of machine learning deployment pipelines, model versioning, automated testing, and deployment automation frameworks.
What’s in it for you?
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
- A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions and stocks where applicable.
- Leaders who support your development through coaching and managing opportunities.
- Ability to make a difference and lasting impact.
- Work in a dynamic, collaborative, progressive and high-performing teams
- Opportunities to take on progressively greater accountabilities
About RBC
Royal Bank of Canada is a global financial institution with a purpose-driven, principles-led approach to delivering leading performance. Our success comes from the 94,000+ employees who leverage their imaginations and insights to bring our vision, values and strategy to life so we can help our clients thrive and communities prosper. As Canada's biggest bank and one of the largest in the world, based on market capitalization, we have a diversified business model with a focus on innovation and providing exceptional experiences to our more than 17 million clients in Canada, the U.S. and 27 other countries. Learn more at rbc.com. We are proud to support a broad range of community initiatives through donations, community investments and employee volunteer activities. See how at www.rbc.com/community-social-impact.
La Banque Royale du Canada est une institution financière mondiale définie par sa raison d'être, guidée par des principes et orientée vers l'excellence en matière de rendement. Notre succès est attribuable aux quelque 94 000+ employés qui mettent à profit leur créativité et leur savoir faire pour concrétiser notre vision, nos valeurs et notre stratégie afin que nous puissions contribuer à la prospérité de nos clients et au dynamisme des collectivités. Selon la capitalisation boursière, nous sommes la plus importante banque du Canada et l'une des plus grandes banques du monde. Nous avons adopté un modèle d'affaires diversifié axé sur l'innovation et l'offre d'expériences exceptionnelles à nos plus de 17 millions de clients au Canada, aux États Unis et dans 27 autres pays. Pour en savoir plus, visitez le site rbc.com/francais
Nous sommes fiers d'appuyer une grande diversité d'initiatives communautaires par des dons, des investissements dans la collectivité et le travail bénévole de nos employés. Pour de plus amples renseignements, visitez le site www.rbc.com/collectivite-impact-social.