Data Engineer - Snowflake / Hadoop

Job summary

Design, build, and maintain scalable data pipelines and architectures for large financial datasets using Snowflake, Hadoop, Spark, PySpark, and Azure. Write maintainable Python and SQL code, optimize workflows, and incorporate data governance, metadata management, and lineage tracking.

Job details

Design, build, and maintain scalable data pipelines using Snowflake, Hadoop, Spark, PySpark, Azure Implement data architectures and optimize workflows for large financial datasets Write high-quality, maintainable Python and SQL code following best practices Integrate data governance, metadata management, and lineage tracking into solutions

What you’ll do

Design, build, and maintain scalable data pipelines and architectures for large financial datasets using Snowflake, Hadoop, Spark, PySpark, and Azure. Write maintainable Python and SQL code, optimize workflows, and incorporate data governance, metadata management, and lineage tracking.

Requirements

The role calls for mid-to-senior-level data engineering experience and the ability to work with Snowflake, Hadoop, Spark, PySpark, and Azure. It also requires strong Python and SQL coding practices and familiarity with data governance, metadata management, and lineage tracking.

Listed skills

• Microsoft Azure · Preferred
• Python · Preferred
• SQL · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Snowflake
• Hadoop
• Spark
• PySpark
• Azure
• Python
• SQL
• Data Pipeline Development
• Data Architecture
• Workflow Optimization
• Data Governance
• Metadata Management
• Data Lineage

Job areas

• Data & Analytics
• Technology
• Software
• Finance & Accounting
• Consulting

More jobs from Viva Tech Solutions