Applications are currently unavailable for this posting.
Browse current jobs- Employment type
- Contract
- Apply by
- Jan 15, 2027
- Posting language
- English
- Application method
- Apply on LinkedIn (LinkedIn sign-in required)
Job summary
Develop ETL/ELT pipelines and large-scale data transformation workflows using Python, PySpark, Apache Spark, and SQL. Work with distributed data processing, cloud platforms, data formats, and relational databases to support big data solutions.
Job details
Pay Range: CAD 60-70/hr Required Technical Skills Strong programming experience in Python 3.x, including OOP, data structures, exception handling, and reusable modules. Hands-on experience with PySpark, Apache Spark, Spark SQL, and Spark DataFrames. Strong expertise in SQL, query optimization, and relational databases. Experience developing ETL/ELT pipelines and large-scale data transformation workflows. Knowledge of distributed computing, parallel processing, and big data architecture. Experience with data formats such as Parquet, Avro, JSON, CSV, and ORC. Experience with databases such as PostgreSQL, SQL Server, Oracle, MySQL, or similar. Hands-on experience with cloud platforms (AWS/Azure/GCP). Knowledge of Git, Jenkins, Azure DevOps, GitHub Actions, or other CI/CD tools. Preferred / Nice-to-Have Skills Experience with Databricks, Delta Lake, and Lakehouse architecture. Knowledge of Snowflake, Amazon Redshift, Azure Synapse Analytics, or BigQuery. Experience with Apache Kafka and real-time streaming. Knowledge of Apache Airflow, AWS Glue, Azure Data Factory, or similar orchestration tools. Experience with Docker and Kubernetes. Understanding of data modeling, dimensional modeling, and data warehousing concepts. Experience with Terraform and cloud infrastructure automation.
What you’ll do
Develop ETL/ELT pipelines and large-scale data transformation workflows using Python, PySpark, Apache Spark, and SQL. Work with distributed data processing, cloud platforms, data formats, and relational databases to support big data solutions.
Requirements
Requires strong Python 3.x programming skills, hands-on experience with PySpark and Apache Spark, and expertise in SQL, query optimization, and relational databases. Candidates should have experience with ETL/ELT, distributed computing, cloud platforms, and CI/CD tools; Databricks, streaming, orchestration, containers, and infrastructure automation are preferred.
Listed skills
- Python · Preferred
- SQL · Preferred
- CI/CD · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Python
- PySpark
- Apache Spark
- Spark SQL
- Spark DataFrames
- SQL
- ETL/ELT Pipelines
- Distributed Computing
- Parallel Processing
- Big Data Architecture
- Cloud Platforms
- CI/CD
- Databricks
- Delta Lake
- Apache Kafka
- Data Modeling
Job areas
- Software
- Data & Analytics
- Technology
More jobs from LanceSoft, Inc.
Database Application Support Engineer
- On-site
- Toronto, ON
- Posted Nov 17, 2026
WebSphere Administrator
- On-site
- Toronto, ON
- Posted Nov 17, 2026
Zendesk Migration Lead
- On-site
- Posted Nov 17, 2026
TDM Architect
- On-site
- Posted Nov 17, 2026
