Position : Sr.Data Engineer

Location: Canada, Remote (Only Canadian Consultants) Duration: Long term contract

Experience : 10 Years MUST

Mandatory Skills : SQL, Data Bricks, SSIS/SSRS/SSAS, user story development, data warehouse design and modeling (3rd normal form and dimensional modeling), data integration design and development and/or performance tuning, Good Communication, user story development, data warehouse design and modeling (3rd normal form and dimensional modeling), data integration design and development and/or performance tuning, problem solving and troubleshooting skills

We are looking for a Senior Data Engineer who will be reporting directly to our Manager, Data Engineering. The position is responsible for data solutions critical to our company’s descriptive and predictive analytics. The successful candidate will perform a broad range of tasks, from mapping business problems to data solutions, developing ETL/ELT solutions, designing logical and physical data models, and promoting data quality. In addition, they will collaborate with senior management and partners with project and resource managers in developing scope, dependencies, estimates, project plans, schedules, status reporting, and issue/risk management.

What you’ll be doing

Note: The essential duties and primary accountabilities below are intended to describe the general content of and requirements of this position and are not intended to be an exhaustive statement of duties. Although all the functions listed here are essential, the extent to which a team member may engage in these activities may vary day-to day. Predictable and reliable attendance is an essential function. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions as described.

• Lead the design and development of data engineering solutions (using Databricks, SQL, DBT, Python, C#, Terraform) for the most critical and complex projects.
• Partner with team members throughout the organization to drive a culture of using data to drive revenue and increase customer growth
• Constantly strive to understand all HQY data. Work closely with the business, mapping their most pressing business problems to data and analytic solutions.
• Jump in and problem solve any part of the data platform architecture or specific solution
• Take a central role in design of the data warehouse
• Be a strong advocate of automation whenever possible. Design and implement automated deployment pipelines for the team.
• Be a strong advocate for data governance and quality. Automate data quality checks.
• Enable data science team to build ML models by providing high quality data.
• Solve issues in unfamiliar technologies or areas of expertise
• Coach and mentor junior team members.

What you will need to be successful

• BS degree in Computer Science, Engineering, Mathematics, or a related field and 8 years of work experience
• Ability and passion to deliver ETL/ELT development projects quickly and efficiently using the Agile development methodology
• Advanced problem solving and troubleshooting skills.
• Demonstrated ability to innovate, drive projects to successful completion and create enduring solutions
• Extensive experience with cloud services (e.g., Azure, AWS, GCP) .
• Advanced knowledge of massive parallel processing datastores (e.g., DataBricks, Delta Lake, Apache Spark, Snowflake, Redshift).
• Advanced knowledge of SQL and Relational Database Management Systems (e.g., Azure SQL, SQL Server, Oracle, MySQL) and NoSQL databases (e.g., MongoDB).
• Advanced Knowledge of ETL processing tools (e.g., DBT, Databricks, Fivetran, SSIS).
• Strong understanding of data modeling techniques (e.g., 3NF, Dimensional) and ability to apply them.
• Strong understanding of terraform and ability to interpret terraform execution plans.
• Proficiency in programming languages common to Data and Analytics (e.g., Python, C#).
• A commitment to data security and privacy.