Opens LinkedIn
- Employment type
- Full-time
- Experience level
- Senior · 8+ years
- Posting language
- English
- Working hours
- 40 hours per week
- Office presence
- 3 days per week
- Seniority
- Mid-Senior level
- Application method
- Direct apply is available
Job summary
Develop and maintain scalable data pipelines using PySpark and Spark SQL to process large datasets efficiently. Perform data transformation and processing across cloud or on-premises environments, with attention to performance and data quality.
Job details
Job Title: Big Data Lead Location: Mississauga, ON Work Arrangement: Hybrid-3 days/ week Employment Type: Full-Time Perm Salary: CAD 125-135K/Year Domain: BFSI Application Deadline: Oct. 30th, 2026 Skills: 8+ years of exp. in developing and maintaining scalable data pipelines using PySpark and Spark SQL for processing large datasets efficiently. Key Skills: PySpark Spark SQL Python ETL / Data Pipelines ETL workflows Big Data Processing Distributed Computing Spark Performance Tuning & Optimization Data Transformation & Manipulation Cloud / On-Premises Data Processing Hadoop & Distributed Storage Unit Testing / Data Quality EEOC Compliance: We are an equal opportunity employer, and all qualified applicants will receive consideration for employment. DISCLAIMER AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.
What you’ll do
Develop and maintain scalable data pipelines using PySpark and Spark SQL to process large datasets efficiently. Perform data transformation and processing across cloud or on-premises environments, with attention to performance and data quality.
Requirements
Requires 8+ years of experience developing and maintaining scalable data pipelines with PySpark and Spark SQL. Relevant skills include Python, ETL workflows, distributed computing, Hadoop, Spark optimization, unit testing, and data quality.
Listed skills
- Python · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- PySpark
- Spark SQL
- Python
- ETL
- Data Pipelines
- ETL Workflows
- Big Data Processing
- Distributed Computing
- Spark Performance Tuning
- Data Transformation
- Data Manipulation
- Cloud Data Processing
- On-Premises Data Processing
- Hadoop
- Distributed Storage
- Unit Testing
Job areas
- Data & Analytics
- Technology
- Software
More jobs from Pacer Group
Software Engineer in Test
- Hybrid
- Toronto, ON
- Posted Oct 21, 2026
React Developer
- Hybrid
- Mississauga, ON
- Posted Oct 21, 2026
React Full stack Developer
- Hybrid
- Mississauga, ON
- Posted Oct 21, 2026
Full stack Developer
- Hybrid
- Mississauga, ON
- Posted Oct 21, 2026
