Opens an external site
- Employment type
- Full-time
- Experience level
- Senior · 5+ years
- Minimum education
- Bachelor’s degree
- Posting language
- English
- Working hours
- 40 hours per week
Job summary
Develop and scale end-to-end data pipelines to transform raw web-scale data into high-quality datasets for training the Scientist AI. This includes implementing algorithmic filtering, quality scoring, and ensuring rigorous benchmark integrity and data provenance.
Job details
Develop and scale end-to-end data pipelines to transform raw web-scale data into high-quality datasets for training the Scientist AI. This includes implementing algorithmic filtering, quality scoring, and ensuring rigorous benchmark integrity and data provenance. Requires a degree in computer science or a related field and 5+ years of experience in data processing or NLP with massive unstructured datasets. Proficiency in Python and distributed processing frameworks like Spark or Ray is essential.
What you’ll do
Develop and scale end-to-end data pipelines to transform raw web-scale data into high-quality datasets for training the Scientist AI. This includes implementing algorithmic filtering, quality scoring, and ensuring rigorous benchmark integrity and data provenance.
Requirements
Requires a degree in computer science or a related field and 5+ years of experience in data processing or NLP with massive unstructured datasets. Proficiency in Python and distributed processing frameworks like Spark or Ray is essential.
Benefits
- Comprehensive Health Benefits
- Mental Health And Wellness Management Account
- 20 Days Of Vacation Per Year
- 4% Employer Retirement Savings Contribution
- Additional Compensation Of 8% For Retirement Savings Or Bonuses
Listed skills
- Python · Preferred
- Docker · Preferred
- Kubernetes · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Python
- Spark
- Ray
- Flink
- Airflow
- Prefect
- Dagster
- Natural Language Processing
- Distributed Processing
- Data Pipeline Engineering
- ML Engineering
- PII Scrubbing
- Data Governance
- Docker
- Kubernetes
- LLM Evaluation
Job areas
- Data & Analytics
- Technology
- Software
- Science & Research
- Engineering
More jobs from LawZero
Gestionnaire senior, Partenariats gouvernementaux
- On-site
- Montréal, QC
- Posted Oct 8, 2026
Senior Manager, Government Partnerships
- On-site
- Montréal, QC
- Posted Oct 8, 2026
Senior Data Platform Engineer
- On-site
- Montréal, QC
- Posted Sep 9, 2026
Développeur.euse sénior, Plateforme de données ML
- On-site
- Montréal, QC
- Posted Sep 9, 2026
