About the role
Agilus is recruiting for a Senior Data Engineer in the Retail in a hybrid work environment in Stellarton, Nova Scotia. We are seeking a Senior Data Engineer to join our retail client’s growing data and analytics team. The ideal candidate will be an expert in building and optimizing large-scale data pipelines on Azure Databricks, with hands-on experience in Azure Data Factory and continuous/real-time data streaming solutions. You will work closely with data scientists, analysts, and business stakeholders to enable advanced analytics, machine learning, and retail-specific use cases such as demand forecasting, customer behavior analysis, personalization, and supply chain optimization.
Responsibilities
- Design, develop, and maintain scalable data pipelines and architectures using Azure Databricks and Azure Data Factory.
- Build and optimize real-time data streaming solutions (e.g., using Spark Structured Streaming, Event Hubs, Kafka, or similar).
- Collaborate with stakeholders to translate retail business requirements into efficient technical data solutions.
- Implement data ingestion frameworks for batch and streaming from diverse sources (e.g., ERP, CRM, POS, IoT, eCommerce).
- Develop reusable components, frameworks, and standards to improve efficiency and consistency across data engineering practices.
- Ensure data quality, governance, security, and compliance with industry and organizational standards.
- Partner with data science and BI teams to support advanced analytics, reporting, and AI/ML initiatives.
Successful Candidates Will Have
- 7+ years of data engineering experience in enterprise-scale environments, preferably in retail or consumer-focused industries.
- Strong expertise in Azure Databricks (PySpark/Scala, Delta Lake, MLflow).
- Proficiency with Azure Data Factory for orchestrating complex ETL/ELT workflows.
- Proven experience with real-time/continuous data streaming frameworks (e.g., Spark Structured Streaming, Kafka, Event Hubs).
- Solid understanding of cloud data architecture principles (data lakes, medallion architecture, CI/CD for data pipelines).
- Advanced SQL and experience with data modeling for analytics and reporting.
- Strong communication and stakeholder management skills, with ability to explain technical concepts to business users.
Additional Competencies
- Experience integrating data from SAP systems (ERP, BW, S/4HANA) into cloud platforms.
- Knowledge of retail-specific data domains (merchandising, inventory, sales, customer loyalty, supply chain).
- Familiarity with Azure Synapse or other modern cloud data warehouses.
- Exposure to DevOps for data engineering (infrastructure as code, Git, CI/CD pipelines).
What's In It For You
- Opportunity to shape the data foundation of a leading retail organization.
- Work with cutting-edge cloud technologies on high-impact, high-visibility projects.
- Collaborative culture with strong emphasis on innovation and professional growth.
Interested?
Please apply directly online
Agilus would like to thank all candidates for their interest in this opportunity. Due to the volume of resumes we receive; we may only be able to respond directly to those candidates being selected for an interview.
We encourage you to visit agilus.ca regularly or subscribe to our email alerts at agilus.ca/Account/Register as new exciting employment opportunities become available daily.
About Agilus Work Solutions
We take on today's recruitment and employment opportunities because we believe in better outcomes - for our clients, our candidates and our employees.
We lead a connected, forward-thinking work community. When candidates and employers connect, positive outcomes can happen. What's possible expands, and potential can be realized.
Core Values At the heart of our mission and guiding every decision, our core values drive us to excellence and shape the way we make a positive impact: We care. We collaborate. We make an impact. We are better with you.
About the role
Agilus is recruiting for a Senior Data Engineer in the Retail in a hybrid work environment in Stellarton, Nova Scotia. We are seeking a Senior Data Engineer to join our retail client’s growing data and analytics team. The ideal candidate will be an expert in building and optimizing large-scale data pipelines on Azure Databricks, with hands-on experience in Azure Data Factory and continuous/real-time data streaming solutions. You will work closely with data scientists, analysts, and business stakeholders to enable advanced analytics, machine learning, and retail-specific use cases such as demand forecasting, customer behavior analysis, personalization, and supply chain optimization.
Responsibilities
- Design, develop, and maintain scalable data pipelines and architectures using Azure Databricks and Azure Data Factory.
- Build and optimize real-time data streaming solutions (e.g., using Spark Structured Streaming, Event Hubs, Kafka, or similar).
- Collaborate with stakeholders to translate retail business requirements into efficient technical data solutions.
- Implement data ingestion frameworks for batch and streaming from diverse sources (e.g., ERP, CRM, POS, IoT, eCommerce).
- Develop reusable components, frameworks, and standards to improve efficiency and consistency across data engineering practices.
- Ensure data quality, governance, security, and compliance with industry and organizational standards.
- Partner with data science and BI teams to support advanced analytics, reporting, and AI/ML initiatives.
Successful Candidates Will Have
- 7+ years of data engineering experience in enterprise-scale environments, preferably in retail or consumer-focused industries.
- Strong expertise in Azure Databricks (PySpark/Scala, Delta Lake, MLflow).
- Proficiency with Azure Data Factory for orchestrating complex ETL/ELT workflows.
- Proven experience with real-time/continuous data streaming frameworks (e.g., Spark Structured Streaming, Kafka, Event Hubs).
- Solid understanding of cloud data architecture principles (data lakes, medallion architecture, CI/CD for data pipelines).
- Advanced SQL and experience with data modeling for analytics and reporting.
- Strong communication and stakeholder management skills, with ability to explain technical concepts to business users.
Additional Competencies
- Experience integrating data from SAP systems (ERP, BW, S/4HANA) into cloud platforms.
- Knowledge of retail-specific data domains (merchandising, inventory, sales, customer loyalty, supply chain).
- Familiarity with Azure Synapse or other modern cloud data warehouses.
- Exposure to DevOps for data engineering (infrastructure as code, Git, CI/CD pipelines).
What's In It For You
- Opportunity to shape the data foundation of a leading retail organization.
- Work with cutting-edge cloud technologies on high-impact, high-visibility projects.
- Collaborative culture with strong emphasis on innovation and professional growth.
Interested?
Please apply directly online
Agilus would like to thank all candidates for their interest in this opportunity. Due to the volume of resumes we receive; we may only be able to respond directly to those candidates being selected for an interview.
We encourage you to visit agilus.ca regularly or subscribe to our email alerts at agilus.ca/Account/Register as new exciting employment opportunities become available daily.
About Agilus Work Solutions
We take on today's recruitment and employment opportunities because we believe in better outcomes - for our clients, our candidates and our employees.
We lead a connected, forward-thinking work community. When candidates and employers connect, positive outcomes can happen. What's possible expands, and potential can be realized.
Core Values At the heart of our mission and guiding every decision, our core values drive us to excellence and shape the way we make a positive impact: We care. We collaborate. We make an impact. We are better with you.