Software Tester

Job summary

Design and develop automated testing frameworks for ETL processes and APIs while managing data pipelines on AWS and Hadoop. Perform complex data validation, root cause analysis, and maintain CI/CD practices to ensure system reliability.

Job details

Key Responsibilities • Design and Develop Automated Testing: Create comprehensive automated testing frameworks for ETL processes and APIs, ensuring data accuracy and system reliability • SQL & Data Analysis: Write complex SQL queries to validate data transformations, perform data profiling, and conduct root cause analysis on data quality issues • Python Development: Develop Python scripts and utilities for test automation, data validation, and reporting • Cloud & Big Data Operations: Manage and optimize data pipelines on AWS S3, work with Hadoop ecosystems, and process Parquet files efficiently • Infrastructure & Version Control: Manage code repositories on GitHub, implement CI/CD best practices, and maintain documentation • QE Methodology: Apply Quality Engineering principles to identify risks early and implement preventative measures throughout the data pipeline • Stakeholder Communication: Document test results, communicate findings to technical and non-technical stakeholders, and provide recommendations for data quality improvements Required Qualifications • SQL Expertise: Advanced proficiency in writing complex SQL queries, stored procedures, and data validation scripts • Python Proficiency: Strong coding skills in Python for automation and data processing • Unix/Linux: Hands-on experience with command-line operations and shell scripting • Cloud Platforms: Demonstrated experience with AWS S3 and cloud-based data management • Big Data Technologies: Working knowledge of Hadoop. “Tekshapers is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.” *Disclaimer: This E-Mail may contain Confidential and/or legally privileged Information and is meant for the intended recipient(s) only. If you have received this e-mail in error and are not the intended recipient/s, kindly notify us at itsupport@tekshapers.com and then delete this e-mail immediately from your system. You are also hereby notified that any use, any form of reproduction, dissemination, copying, disclosure, modification, distribution, and/or publication of this e-mail, its contents, or its attachment/s other than by its intended recipient/s is strictly prohibited and may be unlawful. Internet communication cannot be guaranteed to be secured or error-free as information could be delayed, intercepted, corrupted, lost, or contain viruses. Tekshapers. does not accept any liability for any errors, omissions, viruses or computer problems experienced by any recipient as a result of this e-mail.

What you’ll do

Design and develop automated testing frameworks for ETL processes and APIs while managing data pipelines on AWS and Hadoop. Perform complex data validation, root cause analysis, and maintain CI/CD practices to ensure system reliability.

Requirements

Requires advanced proficiency in SQL, Python, and Unix/Linux command-line operations. Candidates must have demonstrated experience with cloud-based data management in AWS S3 and working knowledge of Hadoop ecosystems.

Listed skills

• SQL · Preferred
• GitHub · Preferred
• CI/CD · Preferred
• Automated testing · Preferred
• Data Validation · Preferred
• Linux · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• SQL
• Python
• Automated testing
• ETL
• API testing
• Data validation
• AWS S3
• Hadoop
• Parquet
• CI/CD
• GitHub
• Unix
• Linux
• Shell scripting
• Quality engineering
• Data profiling

Job areas

• Technology
• Software
• Data & Analytics
• Engineering
• Consulting