Big Data Developer – Snowflake, Spark & AWS
About the role
Big Data Developer – Snowflake, Spark & AWS
Location: Toronto
Hybrid 4 days WFO Position Overview
We are seeking an experienced Senior Big Data Developer to join Royal Bank of Canadas Data Engineering team. You will design| build| and optimize scalable data pipelines and infrastructure to support our enterprise data analytics and business intelligence initiatives.
Key Responsibilities
Design and develop robust ETL/ELT pipelines using Spark| Hive| and Hadoop for large-scale data processing Architect and maintain Snowflake data warehouse solutions| including schema design and optimization Develop and manage infrastructure-as-code solutions using AWS services (S3| Glue| EMR| RDS) Build and deploy containerized applications using Docker/Kubernetes and OpenShift (OCP4) Implement CI/CD pipelines and version control best practices using Git Collaborate with data scientists and analytics teams to ensure data quality and accessibility Mentor junior team members and contribute to technical documentation Leverage Gen AI tools to enhance code quality and development efficiency
Required Qualifications
5+ years of hands-on experience with big data technologies (Hadoop| Spark| Hive) Advanced proficiency with Snowflake platform and data modeling Strong SQL expertise and database design knowledge Proven experience with AWS cloud services Programming experience in Scala| Python| or Java Knowledge of SCM| infrastructure-as-code| and CI/CD pipeline implementation Excellent problem-solving| communication| and self-directed work ethic
Preferred Qualifications
Experience with orchestration tools (Apache Airflow)
ETL tool expertise (Informatica| Talend) API development experience Containerization and Kubernetes expertise Scripting proficiency (Shell| Python) Understanding of Gen AI for code generation
Not the right fit? Search for Big Data Developer jobs in Toronto, Ontario, Canada
About Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Astra - North Infoteck Inc.
Agile - Systems - Technologies - Resources - Applications
Apply for Jobs@ https://careers.astra-north.com/jobs/
We are a global information technology services, management consulting and outsourcing company headquartered in Canada. Astra North helps clients navigate the ever-changing complex information technology landscape with its portfolio of IT consulting services, managed services and staffing and talent management solutions.
The core challenge facing many businesses in their IT functions is the increasing shortage of talent across the globe and its resultant impact on productivity. To overcome this challenge Astra-North provides its clients with a single source Integrated Recruitment Process Outsourcing - iRPO Service. Astra-North works as a specialist strategic partner for its clients by providing the best talent pool of IT Professionals on contract hire, permanent hire or managed services basis through its comprehensive and integrated recruitment, staff augmentation, workforce solutions, recruitment process outsourcing and managed services programs which are customized for individual client needs. Astra North Staffing Services include managing programs that are in compliance with matters focussing on careers, communications, legal and regulatory issues, technology and outsourcing, budgeting and metrics, IT staffing management best practices and global staffing management issues.
Our technical service extends the entire software development lifecycle from Consulting, Business Process Analysis, Requirement Mapping, Analysis, Design, Development, Testing to Implementation and Support. Astra-North Infoteck has expertise in building, maintaining and reengineering IT solutions to meet its client’s evolving needs.We help clients become agile to meet and exceed their goals.
Astra-North ~ Conquering Today's Challenges, Achieving Tomorrow's Vision!
Similar Jobs
Big Data Developer – Snowflake, Spark & AWS
About the role
Big Data Developer – Snowflake, Spark & AWS
Location: Toronto
Hybrid 4 days WFO Position Overview
We are seeking an experienced Senior Big Data Developer to join Royal Bank of Canadas Data Engineering team. You will design| build| and optimize scalable data pipelines and infrastructure to support our enterprise data analytics and business intelligence initiatives.
Key Responsibilities
Design and develop robust ETL/ELT pipelines using Spark| Hive| and Hadoop for large-scale data processing Architect and maintain Snowflake data warehouse solutions| including schema design and optimization Develop and manage infrastructure-as-code solutions using AWS services (S3| Glue| EMR| RDS) Build and deploy containerized applications using Docker/Kubernetes and OpenShift (OCP4) Implement CI/CD pipelines and version control best practices using Git Collaborate with data scientists and analytics teams to ensure data quality and accessibility Mentor junior team members and contribute to technical documentation Leverage Gen AI tools to enhance code quality and development efficiency
Required Qualifications
5+ years of hands-on experience with big data technologies (Hadoop| Spark| Hive) Advanced proficiency with Snowflake platform and data modeling Strong SQL expertise and database design knowledge Proven experience with AWS cloud services Programming experience in Scala| Python| or Java Knowledge of SCM| infrastructure-as-code| and CI/CD pipeline implementation Excellent problem-solving| communication| and self-directed work ethic
Preferred Qualifications
Experience with orchestration tools (Apache Airflow)
ETL tool expertise (Informatica| Talend) API development experience Containerization and Kubernetes expertise Scripting proficiency (Shell| Python) Understanding of Gen AI for code generation
Not the right fit? Search for Big Data Developer jobs in Toronto, Ontario, Canada
About Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Astra - North Infoteck Inc.
Agile - Systems - Technologies - Resources - Applications
Apply for Jobs@ https://careers.astra-north.com/jobs/
We are a global information technology services, management consulting and outsourcing company headquartered in Canada. Astra North helps clients navigate the ever-changing complex information technology landscape with its portfolio of IT consulting services, managed services and staffing and talent management solutions.
The core challenge facing many businesses in their IT functions is the increasing shortage of talent across the globe and its resultant impact on productivity. To overcome this challenge Astra-North provides its clients with a single source Integrated Recruitment Process Outsourcing - iRPO Service. Astra-North works as a specialist strategic partner for its clients by providing the best talent pool of IT Professionals on contract hire, permanent hire or managed services basis through its comprehensive and integrated recruitment, staff augmentation, workforce solutions, recruitment process outsourcing and managed services programs which are customized for individual client needs. Astra North Staffing Services include managing programs that are in compliance with matters focussing on careers, communications, legal and regulatory issues, technology and outsourcing, budgeting and metrics, IT staffing management best practices and global staffing management issues.
Our technical service extends the entire software development lifecycle from Consulting, Business Process Analysis, Requirement Mapping, Analysis, Design, Development, Testing to Implementation and Support. Astra-North Infoteck has expertise in building, maintaining and reengineering IT solutions to meet its client’s evolving needs.We help clients become agile to meet and exceed their goals.
Astra-North ~ Conquering Today's Challenges, Achieving Tomorrow's Vision!