Opens LinkedIn
- Employment type
- Full-time
- Experience level
- Senior
- Posting language
- English
- Application method
- Apply on LinkedIn (LinkedIn sign-in required)
Job summary
Design, develop, test, and maintain large-scale data processing and persistence components, primarily for big data platforms and production environments. Provide technical leadership, collaborate with architects and operations teams, advise on implementation effort, and coach and mentor team members.
Job details
Sr Data Engineer Toronto (hybird) $110-120k Global software consultancy As a Senior Data Engineer, you will be responsible or designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Senior Data Engineers provide strong development leadership and take responsibility for significant technical components of data systems. You will work within a multi-skilled agile team to design and develop large-scale data processing software to meet user needs in demanding production environments. Your responsibilities will include working to develop data processing software primarily for deployment in Big Data technologies. The role encompasses the full software lifecycle including design, code, test and defect resolution. Working with Architects and Lead Engineers to ensure the software supports non-functional needs. Collaborating with colleagues to resolve implementation challenges and ensure code quality and maintainability remains high. Leads by example in code quality. Working with operations teams to ensure operational readiness. Advising customers and managers on the estimated effort and technical implications of user stories and user journeys. Coaching and mentoring team members MINIMUM (ESSENTIAL) REQUIREMENTS: • Strong software development experience in one of Java, Scala, or Python • Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks. • Experience of developing substantial components for large-scale data processing solutions and deploying into a production environment • Proficient in SQL and SQL extensions for analytical queries • Solid understanding of ETL/ELT data processing pipelines and design patterns • Aware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formats • Able to write quality, testable code and has experience of automated testing • Experience with Continuous Integration and Continuous Deployment techniques DESIRABLE: • Experience of data pipeline development • Experience of Docker and Kubernetes • Experience of performance tuning • Experience of data visualisation and complex data transformations • Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products • Expertise in continuous improvement and sharing input on data best practice
What you’ll do
Design, develop, test, and maintain large-scale data processing and persistence components, primarily for big data platforms and production environments. Provide technical leadership, collaborate with architects and operations teams, advise on implementation effort, and coach and mentor team members.
Requirements
Candidates need strong software development experience in Java, Scala, or Python, along with experience building and deploying large-scale data processing solutions on cloud or data platforms. They should be proficient in analytical SQL, ETL/ELT design, distributed data technologies, automated testing, and CI/CD.
Listed skills
- Java · Preferred
- Python · Preferred
- SQL · Preferred
- Amazon Web Services · Preferred
- Microsoft Azure · Preferred
- Automated testing · Preferred
- CI/CD · Preferred
- Docker · Preferred
- Kubernetes · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Java
- Scala
- Python
- SQL
- Data Processing
- ETL/ELT
- Distributed Data Processing
- AWS
- Azure
- Google Cloud Platform
- Databricks
- Automated Testing
- Continuous Integration
- Continuous Deployment
- Docker
- Kubernetes
Job areas
- Technology
- Data & Analytics
- Software
- Consulting
More jobs from MPA Recruitment
Family Physician
- On-site
- Calgary, AB
- Posted Nov 17, 2026
Nurse Practitioner
- On-site
- NS
- Posted Nov 17, 2026
Senior Data Engineer
- On-site
- Halifax, NS
- Posted Nov 16, 2026
Superintendent
- On-site
- Hamilton, ON
- Posted Nov 13, 2026
