Senior AWS Data Engineer/Architect
About the role
Job Description:
On behalf of our public sector client, Affinity is looking for a Senior AWS Data Engineer/Architect to help us establish a CI/CD deployment system and optimal patterns for monitoring, notifications, security, and data pipelines from a variety of source systems. The role demands strong cloud data engineering skills, expertise with AWS services, and a collaborative mindset to work with data warehouse, IT, and security teams.
Responsibilities:
• Collaborate with IT and the data Management team to design a CI/CD deployment system for the AWS data lake account
• Develop optimal patterns for monitoring, notifications, and security, including monitoring dashboards and alerting configurations
• Assist in developing data pipeline and orchestration design patterns from a variety of source systems using AWS tools such as Glue, Step Functions, and DMS
• Ensure security and data access best practices (IAM roles, encryption, Lake Formation)
Education and Experience
• Degree in computer science, computer engineering, system engineering, big data, statistics, or equivalent work experience
• Typically requires over 6 yearof s data engineering, applied data science, or software engineering experience
• Experience with large-scale data migrations or cloud modernization projects
Knowledge and Skills
• Capability to architect highly scalable distributed systems, using AWS tools.
• Demonstrated experience with agile or other rapid application development methods
• Familiarity with DevOps best practices
• Understands data pipeline technologies and tools and has experience building high-performance data systems.
• Extensive knowledge in SQL and scripting languages such as Python
• Expert knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases.
• Experience using AWS technologies, including S3, Redshift, AWS Glue, CloudFormation, CloudWatch
• Experience withthe integration of data from multiple data sources and multiple styles of APIs
• Experience working with SQL databases such as Oracle, SQL Server, MySQL, and Redshift
• Knowledge of various ETL techniques and frameworks
Competencies:
• Architecting secure and scalable systems
• Strong communication skills for cross-team collaboration
• Ability to mentor and guide other team members
Affinity Earn:
Know someone who’s great for this, or any of our open roles? Earn up to $4,000/year for each successful referral through Affinity Earn. You can also earn up to $50,000 for helping us find new clients. Learn about our referral program at https://affinity-group.ca/earn/ or browse our jobs & follow us at https://www.linkedin.com/company/affinity-staffing/jobs/
About Affinity:
Affinity Group is a technology and business consulting and services company. We believe in creating long term relationships between clients and consultants that foster a mutually beneficial partnership. Affinity is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All employment is decided on the basis of qualifications, merit and business need.
For more information on Affinity, please visit www.affinity-group.ca
Job Number: 12745
About Affinity
Welcome to Affinity Group — your trusted partner in business and technology consulting. As a carbon-neutral company certified by ClimatePartner and recognized by the Globe and Mail as one of Canada's fastest-growing companies, we are dedicated to delivering an unrivalled experience for our employees, consultants, and clients.
Professional Excellence Across Disciplines:
- Cyber Security Solutions: Protecting your operations with cutting-edge security measures.
- Data Analytics and Business Intelligence: Transforming data into strategic insights.
- Digital Transformation: Pioneering digital innovations to future-proof your business.
- Enterprise Applications: Streamlining business processes through advanced software solutions.
- Project Management: Delivering projects with precision and efficiency.
- Technology Strategy & Architecture: Crafting robust IT frameworks to support scalable growth.
Delivering Tailored Solutions: We provide flexible, bespoke solutions designed to meet the specific demands of your business, driving your success forward with precision and innovation.
Global Reach with Affinity International: Expand your capabilities with our international talent solutions. Discover how we bring global expertise to your local and international projects at affinity-group.ca/international-companies.
Empowering Our Consultants: We are committed to facilitating professional growth and success. Explore a wide array of job opportunities through our referral program, AffinityEARN. Find your next challenge on our jobs page at affinity-group.ca/jobs or LinkedIn.
Ready to Enhance Your Business? Contact us today to discuss how we can support your goals. Email us at Sales@affinity-group.ca for inquiries and solutions tailored to your needs.
Join the innovative and supportive environment at Affinity Group, where we transform challenges into opportunities and individual potential into achievements. Discover more about how we can collaborate on our website below!
Senior AWS Data Engineer/Architect
About the role
Job Description:
On behalf of our public sector client, Affinity is looking for a Senior AWS Data Engineer/Architect to help us establish a CI/CD deployment system and optimal patterns for monitoring, notifications, security, and data pipelines from a variety of source systems. The role demands strong cloud data engineering skills, expertise with AWS services, and a collaborative mindset to work with data warehouse, IT, and security teams.
Responsibilities:
• Collaborate with IT and the data Management team to design a CI/CD deployment system for the AWS data lake account
• Develop optimal patterns for monitoring, notifications, and security, including monitoring dashboards and alerting configurations
• Assist in developing data pipeline and orchestration design patterns from a variety of source systems using AWS tools such as Glue, Step Functions, and DMS
• Ensure security and data access best practices (IAM roles, encryption, Lake Formation)
Education and Experience
• Degree in computer science, computer engineering, system engineering, big data, statistics, or equivalent work experience
• Typically requires over 6 yearof s data engineering, applied data science, or software engineering experience
• Experience with large-scale data migrations or cloud modernization projects
Knowledge and Skills
• Capability to architect highly scalable distributed systems, using AWS tools.
• Demonstrated experience with agile or other rapid application development methods
• Familiarity with DevOps best practices
• Understands data pipeline technologies and tools and has experience building high-performance data systems.
• Extensive knowledge in SQL and scripting languages such as Python
• Expert knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases.
• Experience using AWS technologies, including S3, Redshift, AWS Glue, CloudFormation, CloudWatch
• Experience withthe integration of data from multiple data sources and multiple styles of APIs
• Experience working with SQL databases such as Oracle, SQL Server, MySQL, and Redshift
• Knowledge of various ETL techniques and frameworks
Competencies:
• Architecting secure and scalable systems
• Strong communication skills for cross-team collaboration
• Ability to mentor and guide other team members
Affinity Earn:
Know someone who’s great for this, or any of our open roles? Earn up to $4,000/year for each successful referral through Affinity Earn. You can also earn up to $50,000 for helping us find new clients. Learn about our referral program at https://affinity-group.ca/earn/ or browse our jobs & follow us at https://www.linkedin.com/company/affinity-staffing/jobs/
About Affinity:
Affinity Group is a technology and business consulting and services company. We believe in creating long term relationships between clients and consultants that foster a mutually beneficial partnership. Affinity is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All employment is decided on the basis of qualifications, merit and business need.
For more information on Affinity, please visit www.affinity-group.ca
Job Number: 12745
About Affinity
Welcome to Affinity Group — your trusted partner in business and technology consulting. As a carbon-neutral company certified by ClimatePartner and recognized by the Globe and Mail as one of Canada's fastest-growing companies, we are dedicated to delivering an unrivalled experience for our employees, consultants, and clients.
Professional Excellence Across Disciplines:
- Cyber Security Solutions: Protecting your operations with cutting-edge security measures.
- Data Analytics and Business Intelligence: Transforming data into strategic insights.
- Digital Transformation: Pioneering digital innovations to future-proof your business.
- Enterprise Applications: Streamlining business processes through advanced software solutions.
- Project Management: Delivering projects with precision and efficiency.
- Technology Strategy & Architecture: Crafting robust IT frameworks to support scalable growth.
Delivering Tailored Solutions: We provide flexible, bespoke solutions designed to meet the specific demands of your business, driving your success forward with precision and innovation.
Global Reach with Affinity International: Expand your capabilities with our international talent solutions. Discover how we bring global expertise to your local and international projects at affinity-group.ca/international-companies.
Empowering Our Consultants: We are committed to facilitating professional growth and success. Explore a wide array of job opportunities through our referral program, AffinityEARN. Find your next challenge on our jobs page at affinity-group.ca/jobs or LinkedIn.
Ready to Enhance Your Business? Contact us today to discuss how we can support your goals. Email us at Sales@affinity-group.ca for inquiries and solutions tailored to your needs.
Join the innovative and supportive environment at Affinity Group, where we transform challenges into opportunities and individual potential into achievements. Discover more about how we can collaborate on our website below!