Data Engineer - Python, PySpark, SQL, Snowflake & API Integration

Job summary

Design, build, and optimize scalable data pipelines and ETL/ELT workflows using Python, PySpark, SQL, and Snowflake, integrating REST APIs and external data sources. Implement data quality, validation, monitoring, and automation, and collaborate with engineering and analytics teams to deliver reliable data solutions.

Job details

Job Description: We are seeking a skilled Data Engineer with strong hands-on experience in Python, PySpark, SQL, Snowflake, and API integrations to build scalable data pipelines and cloud-based data solutions. Key Responsibilities: Design, develop, and optimize data pipelines using Python, PySpark, SQL, and Snowflake. Integrate REST APIs and external data sources into Snowflake-based data platforms. Build and maintain ETL/ELT workflows for data ingestion, transformation, and processing. Develop efficient SQL queries and optimize Snowflake performance. Implement data quality, validation, monitoring, and automation. Collaborate with engineering and analytics teams to deliver reliable data solutions. Required Qualifications: 3+ years of experience in Data Engineering. Strong hands-on expertise in Python, PySpark, SQL, and Snowflake. Experience with REST APIs, JSON, and API-based data integration. Knowledge of ETL/ELT processes, data modeling, and data warehousing. Experience with cloud platforms such as AWS, Azure, or GCP is preferred.

What you’ll do

Design, build, and optimize scalable data pipelines and ETL/ELT workflows using Python, PySpark, SQL, and Snowflake, integrating REST APIs and external data sources. Implement data quality, validation, monitoring, and automation, and collaborate with engineering and analytics teams to deliver reliable data solutions.

Requirements

Requires at least 3 years of data engineering experience and strong hands-on expertise in Python, PySpark, SQL, and Snowflake. Candidates should have experience with REST APIs, JSON, API-based integration, ETL/ELT, data modeling, and data warehousing; experience with AWS, Azure, or GCP is preferred.

Listed skills

• Microsoft Azure · Preferred
• SQL · Preferred
• REST APIs · Preferred
• Amazon Web Services · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Python
• PySpark
• SQL
• Snowflake
• REST APIs
• API Integration
• JSON
• ETL/ELT
• Data Pipelines
• Data Modeling
• Data Warehousing
• Data Quality
• Performance Optimization
• Cloud Platforms
• AWS
• Azure

Job areas

• Data & Analytics
• Technology
• Software

More jobs from TechNeptune Consulting Inc.