Développeur Senior Traitement de Données ML

Job summary

Develop and scale data pipelines that transform raw web-scale data into high-signal training sets for AI research. This includes implementing algorithmic filtering, quality scoring, and ensuring data integrity and compliance.

Job details

Develop and scale data pipelines that transform raw web-scale data into high-signal training sets for AI research. This includes implementing algorithmic filtering, quality scoring, and ensuring data integrity and compliance. Requires a degree in Computer Science or a related field and over 5 years of experience in ML engineering or NLP with massive unstructured datasets. Proficiency in Python and distributed processing frameworks like Spark or Ray is essential.

What you’ll do

Develop and scale data pipelines that transform raw web-scale data into high-signal training sets for AI research. This includes implementing algorithmic filtering, quality scoring, and ensuring data integrity and compliance.

Requirements

Requires a degree in Computer Science or a related field and over 5 years of experience in ML engineering or NLP with massive unstructured datasets. Proficiency in Python and distributed processing frameworks like Spark or Ray is essential.

Benefits

• Comprehensive Health Benefits
• Mental Health and Well-being Account
• 20 Days of Annual Vacation
• 4% Employer Retirement Savings Contribution
• 8% Additional Compensation for Retirement or Bonuses

Listed skills

• Python · Preferred
• Docker · Preferred
• Kubernetes · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Python
• Distributed Processing
• Machine Learning Engineering
• Natural Language Processing
• Data Pipeline Design
• Spark
• Ray
• Flink
• Airflow
• Prefect
• Dagster
• LLM Evaluation
• Data Privacy
• Data Governance
• Docker
• Kubernetes

Job areas

• Data & Analytics
• Software
• Technology
• Science & Research
• Engineering

More jobs from LawZero