RQ11580 - Software Developer - Senior

Job summary

The software developer will execute and monitor batch inference jobs on Databricks while troubleshooting model anomalies. They will also support pipeline evaluation, maintain reproducible scripts, and prepare datasets for benchmarking.

Job details

Description: The Government of Ontario is embarking on a large Data & AI transformation initiative. Core to the transformation is the enablement of the Ontario Data Platform (ODP), which is being developed as the enterprise technology ecosystem for everything Data & AI. ODP is a modern ecosystem of data solution consisting of data ingestion technologies, storage, processing and visualization as well as solutions related to data governance, quality, marketplace, etc. ODP will initially serve all internal government clusters, ministries and program areas, but also external agencies in the future. We are looking for a data scientist to support various initiatives related to the platform as well as the execution of use cases to support the needs of various businesses within the government. Requirements Experience and Skill Set Requirements: Must Haves: Background in Computer Science, Data Science, or AI/ML (student or recent grad is good). Familiarity with Python and libraries like pandas, scikit-learn, or PyTorch. Exposure to LLM frameworks (DSPy, LangChain, Hugging Face, or equivalent). Comfortable working with Databricks / MLflow or other cloud ML environments. Detail-oriented with strong organizational skills for tracking experiments. Skill Set Requirements: Key Responsibilities: Run and Monitor Inferences Execute batch inference jobs on Databricks and other environments. Troubleshoot inference issues, log results, and escalate model anomalies. Pipeline & Evaluation Support Assist with running DSPy pipelines and loading custom models/configs. Support evaluation runs using internal metrics Track and summarize performance metrics for inference experiments. Data Handling & Experimentation Help prepare and clean legal text datasets for inference and evaluation. Annotate outputs to support error analysis and benchmarking. Maintain reproducible scripts/notebooks for inference runs. Evaluation Criteria: Technical Skills LLM frameworks Databricks/MLflow

What you’ll do

The software developer will execute and monitor batch inference jobs on Databricks while troubleshooting model anomalies. They will also support pipeline evaluation, maintain reproducible scripts, and prepare datasets for benchmarking.

Requirements

Candidates must have a background in Computer Science, Data Science, or AI/ML with proficiency in Python and relevant libraries. Experience with LLM frameworks and cloud ML environments like Databricks is required.

Listed skills

• Python · Preferred
• Machine learning · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Python
• Pandas
• Scikit-learn
• PyTorch
• LLM Frameworks
• DSPy
• LangChain
• Hugging Face
• Databricks
• MLflow
• Data Science
• Machine Learning
• Data Ingestion
• Data Governance
• Inference Monitoring
• Troubleshooting (Problem Solving)
• Benchmarking
• Detail Oriented
• Artificial Intelligence
• Organizational Skills
• Python (Programming Language)
• Technology Ecosystems
• Computer Science
• Business Metrics
• Performance Metric
• Pandas (Python Package)
• PyTorch (Machine Learning Library)
• Scikit-Learn (Python Package)
• Hugging Face (NLP Framework)
• Error Analysis (Numerical Analysis)

Job areas

• Technology
• Data & Analytics
• Software
• Government & Public Sector
• Science & Research
• Software Developer
• Software Developer / Engineer
• Software Developers

More jobs from Maarut Inc