ETL SDET

Job summary

Design, develop, and execute automated test frameworks to validate ETL pipelines, large-scale data processing workflows, and cloud-based data platforms. Perform data quality, reconciliation, backend, SQL-based, and end-to-end testing of data pipelines across AWS environments.

Job details

Job Summary We are looking for an experienced ETL SDET with strong expertise in Python, PySpark, AWS, and data engineering testing. The ideal candidate will be responsible for designing, developing, and executing automated test frameworks to validate complex ETL pipelines, large-scale data processing workflows, and cloud-based data platforms. The candidate should have hands-on experience in data quality validation, backend testing, SQL-based testing, and automation of data pipelines across AWS environments. Required Skills and Qualifications 8+ years of experience in software testing, test automation, ETL testing, or QA. Strong programming experience in Python for test automation and data validation. Hands-on experience with PySpark and distributed data processing. Strong knowledge of ETL/ELT processes, data pipelines, and data warehouse testing. Advanced SQL skills, including joins, subqueries, CTEs, aggregations, and complex data validation queries. Practical experience with AWS cloud services, particularly S3, Glue, Redshift, EMR, or Lambda. Experience building and maintaining automated testing frameworks. Strong understanding of data quality, data reconciliation, source-to-target mapping, and data integrity testing. Experience with functional, integration, regression, and end-to-end testing. Familiarity with Git, CI/CD pipelines, and defect tracking tools such as Jira. Strong analytical, debugging, and problem-solving skills. Excellent communication and collaboration skills.

What you’ll do

Design, develop, and execute automated test frameworks to validate ETL pipelines, large-scale data processing workflows, and cloud-based data platforms. Perform data quality, reconciliation, backend, SQL-based, and end-to-end testing of data pipelines across AWS environments.

Requirements

Requires 8+ years of experience in software testing, test automation, ETL testing, or QA, with strong Python, PySpark, SQL, and AWS experience. Candidates should also have expertise in data quality and integrity testing, automated frameworks, functional and integration testing, CI/CD, Git, and defect tracking.

Listed skills

• Python · Preferred
• Amazon Web Services · Preferred
• SQL · Preferred
• CI/CD · Preferred
• Git · Preferred
• Jira · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Python
• PySpark
• AWS
• ETL Testing
• Test Automation
• SQL
• Data Quality Validation
• Data Pipeline Testing
• Data Warehouse Testing
• Source-to-Target Mapping
• Data Reconciliation
• Data Integrity Testing
• CI/CD
• Git
• Jira
• Backend Testing

Job areas

• Software
• Technology
• Data & Analytics

More jobs from Quantum World Technologies Inc.