Test Automation Engineer - ETL

Job summary

Support and optimize ETL/ELT pipelines and data lake processing using Azure Data Factory and Azure Databricks, while monitoring and troubleshooting pipeline and production issues. Perform and automate end-to-end ETL testing, data quality checks, reconciliation, and validation, and integrate automated scripts into CI/CD pipelines.

Job details

Job Description Job Description We are looking for a highly motivated 6-8 years of ETL Test Automation Engineer with strong expertise in Azure Data Factory (ADF), Azure Databricks, Python, SQL, and ETL Testing. Key Responsibilities Support ETL/ELT pipelines using Azure Data Factory and Azure Databricks. Optimize data ingestion frameworks and Data Lake processing pipelines. Implement data quality checks, data reconciliation, and validation frameworks. Monitor and troubleshoot data pipeline failures, performance bottlenecks, and production issues. Perform end-to-end ETL testing across source and target systems. Execute source-to-target validation, reconciliation, schema validation, and data integrity checks. Create and execute SQL-based validation scripts for large datasets. Validate transformation logic, business rules, and incremental data loads. Identify, track, and support closure of ETL and data quality defects. Support SIT, UAT, Regression, and Production validation activities. Automate regression and reconciliation activities to reduce manual effort. Integrate automated validation scripts into CI/CD pipelines. Drive continuous improvement through automation and AI-assisted testing practices. Required Technical Skills Azure Databricks Azure Data Factory (ADF) Python PySpark SQL / Azure SQL ETL Testing Bitbucket / Git Mandatory Skills: ETL Testing Experience: 3-5 Years The expected compensation for this role ranges from CAD 57000 to CAD 90000 . Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention. Wipro is committed to creating an accessible, supportive, and inclusive workplace. Reasonable accommodation will be provided to all applicants including persons with disabilities, throughout the recruitment and selection process. Accommodations must be communicated in advance of the application, where possible, and will be reviewed on an individual basis. Wipro provides equal opportunities to all and values diversity.

What you’ll do

Support and optimize ETL/ELT pipelines and data lake processing using Azure Data Factory and Azure Databricks, while monitoring and troubleshooting pipeline and production issues. Perform and automate end-to-end ETL testing, data quality checks, reconciliation, and validation, and integrate automated scripts into CI/CD pipelines.

Requirements

The role calls for 6–8 years of ETL test automation experience, with strong expertise in Azure Data Factory, Azure Databricks, Python, SQL, and ETL testing. The posting also lists 3–5 years of ETL testing experience as a mandatory skill and requires experience with PySpark, Azure SQL, and Bitbucket or Git.

Listed skills

• SQL · Preferred
• CI/CD · Preferred
• Git · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Azure Databricks
• Azure Data Factory
• Python
• PySpark
• SQL
• Azure SQL
• ETL Testing
• Bitbucket
• Git
• ETL/ELT Pipelines
• Data Quality Validation
• Data Reconciliation
• CI/CD
• Regression Testing
• Source-to-Target Validation

Job areas

• Technology
• Data & Analytics
• Software

More jobs from Wipro