Python, PySpark_London

London, ON
On-site
Posted Oct 9, 2026
1 position

Applications are currently unavailable for this posting.

Employment type: Contract
Posting language: English
Application method: Apply on LinkedIn (LinkedIn sign-in required)

Job summary

Design, develop, and maintain scalable ETL pipelines using AWS Glue, Python, and PySpark, including configuring Glue jobs, crawlers, and workflows. Manage cloud data storage, access control, orchestration, monitoring, and Spark performance, and document data flows and technical decisions.

Job details

Design, develop and maintain scalable ETL pipelines using AWS glue and python, write PySpark scripts for extraction, transformation and loading, configure glue jobs, crawlers and workflows for automated data processing. Cloud Data Engineering: Work with AWS S3 for data storage and management. Use AWS IAM for access control and security, Leverage AWS Lambda for serverless orchestration and event driven processing. Monitor Glue jon metrics, using AWS cloud watch, Tune Spark configurations for Optimal performance. Document ETL processes, data flows, and technical decisions Experience with infrastructure as code (Terraform, CloudFormation)

What you’ll do

Requirements

The role calls for experience with Python, PySpark, AWS Glue, and cloud data engineering services including S3, IAM, Lambda, and CloudWatch. Experience with infrastructure-as-code tools such as Terraform or CloudFormation is also specified.

Listed skills

Python · Preferred
Terraform · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

Python
PySpark
ETL Pipeline Development
AWS Glue
AWS S3
AWS IAM
AWS Lambda
AWS CloudWatch
Apache Spark Performance Tuning
Data Engineering
Infrastructure as Code
Terraform
AWS CloudFormation
Data Pipeline Documentation

Job areas

Technology
Data & Analytics
Software
Consulting