ThoughtStorm
Toronto, ON · Posted Nov 6, 2026

Junior Data Engineer – Azure Databricks / ADF / PySpark

ContractOn-site1 position

Applications are currently unavailable for this posting.

Browse current jobs
Save

Share this job

Help the right person find this opportunity.

The job in 20 seconds

LocationToronto, ON
Employment typeContract
Experience levelJunior
Minimum educationCollege diploma

Job summary

Develop and maintain scalable data ingestion and ETL/ELT pipelines using Azure Data Factory, Azure Databricks, PySpark, and related Azure data services. Build and optimize Databricks jobs and Delta Lake tables, while supporting data quality, monitoring, deployment automation, and governance.

Job details

Required Skills & Qualifications Degree or diploma in Computer Science, Software Engineering, Information Technology, or a related field. Hands-on experience developing data engineering solutions using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Databricks. Strong programming skills in Python, SQL, PySpark, and Apache Spark for data processing and transformation. Experience developing and maintaining ETL/ELT pipelines, data ingestion frameworks, and scalable batch or near real-time data processing solutions. Hands-on knowledge of Delta Lake, Lakehouse Architecture, and Medallion Architecture (Bronze, Silver, Gold). Experience developing Databricks notebooks, workflows, data processing jobs, and optimizing Delta Lake tables. Strong understanding of data validation, data quality, reconciliation, monitoring, and troubleshooting of data pipelines. Experience with Azure DevOps, Git, CI/CD pipelines, automated deployments, and version control. Knowledge of REST APIs, data integration patterns, automation frameworks, and reusable development utilities. Understanding of data governance, metadata management, data cataloguing, security, privacy, and access control. Experience with software development best practices, including code reviews, automated testing, documentation, and secure coding. Strong communication and collaboration skills, with experience working in Agile/Scrum teams alongside architects, data engineers, analysts, and business stakeholders.

What you’ll do

Develop and maintain scalable data ingestion and ETL/ELT pipelines using Azure Data Factory, Azure Databricks, PySpark, and related Azure data services. Build and optimize Databricks jobs and Delta Lake tables, while supporting data quality, monitoring, deployment automation, and governance.

Requirements

Requires a degree or diploma in computer science, software engineering, information technology, or a related field, along with hands-on experience building data engineering solutions on Azure. Candidates should have strong Python, SQL, PySpark, and Spark skills, experience with data pipelines and Lakehouse patterns, and familiarity with CI/CD, data quality, governance, and Agile collaboration.

Listed skills

  • Python · Preferred
  • SQL · Preferred
  • Git · Preferred
  • CI/CD · Preferred
  • REST APIs · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

  • Azure Data Factory
  • Azure Data Lake Storage
  • Azure Databricks
  • Python
  • SQL
  • PySpark
  • Apache Spark
  • ETL/ELT Pipelines
  • Delta Lake
  • Lakehouse Architecture
  • Medallion Architecture
  • Azure DevOps
  • Git
  • CI/CD
  • REST APIs
  • Data Quality

Job areas

  • Data & Analytics
  • Technology
  • Software
  • Consulting
About the employer
ThoughtStorm

Think Beyond

More jobs from ThoughtStorm

See all jobs from ThoughtStorm
ThoughtStorm
ThoughtStorm
Toronto, ON

Siebel Software Engineer

ContractOn-site
ThoughtStorm
ThoughtStorm
Edmonton, Alberta

Senior Business Transformation & Change Management Consultant

ContractRemote
ThoughtStorm
ThoughtStorm
Canada

AS400 Solution Designer

ContractRemote
ThoughtStorm
ThoughtStorm
Toronto, ON

Senior Cloud & Enterprise Database Administrator

ContractOn-site