Find your next opportunity
J&M Group
Job summary
Design, develop, and support scalable data pipelines and distributed data platforms. Lead the migration of on-premises data systems to AWS cloud and optimize data workflows.
Job details
Role Summary Seeking an experienced Data Platform Engineer with strong Netezza expertise. Design, develop, and support scalable data pipelines and distributed data platforms. Work with AWS Cloud, Big Data, Data Warehousing, ETL, and real-time data processing. Support data platform modernization and on-premises to AWS cloud migration initiatives. Required Technical Skills AWS Cloud AWS EMR EC2 S3 VPC RDS Redshift AWS Glue IAM CloudWatch CloudFormation Airflow / AWS Managed Workflows Databases & Data Warehousing Netezza Mandatory SQL Server PostgreSQL Teradata Amazon Redshift ETL / Data Integration SSIS Pentaho or similar ETL tools ETL/ELT processes Programming & Scripting Strong SQL Shell scripting Python Good to have Operating Systems Strong Unix/Linux experience Key Responsibilities Design, develop, maintain, and support scalable data pipelines. Lead and support on-premises to AWS cloud migration initiatives. Leverage Netezza expertise for data migration and platform modernization. Develop and manage ETL/ELT processes using SSIS, Pentaho, or similar tools. Implement and manage AWS services including EMR, S3, EC2, Redshift, Glue, and Airflow. Build and optimize data workflows and orchestration pipelines. Work with real-time streaming technologies such as Kafka and Spark Streaming. Perform data ingestion, transformation, and validation across multiple data sources. Optimize SQL queries for performance and scalability. Monitor platform performance and troubleshoot technical issues. Ensure data platform reliability, scalability, and performance. Collaborate with developers, architects, infrastructure teams, and business stakeholders. Must-Have Skills 10+ years of Data Engineering / Big Data / Platform Engineering experience Hands-on Netezza experience Mandatory Strong AWS Cloud experience Strong SQL and Shell scripting Experience with ETL/ELT Strong Unix/Linux experience Data Warehousing experience Data migration and modernization experience Experience building scalable data pipelines Experience with distributed data systems Nice-to-Have Skills Python Kafka Spark Streaming Airflow Pentaho AWS data migration experience
What you’ll do
Design, develop, and support scalable data pipelines and distributed data platforms. Lead the migration of on-premises data systems to AWS cloud and optimize data workflows.
Requirements
Requires over 10 years of experience in data engineering with mandatory expertise in Netezza and AWS Cloud. Proficiency in SQL, shell scripting, and ETL processes is essential.
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Netezza
- AWS Cloud
- SQL
- Shell Scripting
- ETL/ELT
- Unix/Linux
- Data Warehousing
- Python
- Amazon Redshift
- AWS Glue
- Airflow
- Kafka
- Spark Streaming
- Data Migration
- AWS EMR
- S3
Job areas
- Data & Analytics
- Technology
- Engineering
- Software
- Consulting
