Overview:

Adastra is hiring! We are looking for a hands-on GCP Data Engineers to join our Data Engineering team for a client undergoing a large cloud transformation and Hadoop to GCP migration initiative. The successful candidate is accountable for delivering the infrastructure solutions of assigned GCP data applications throughout the complete use case lifecycle. Responsibilities include identifying and documenting big data use case requirements; leading the design and development of solutions; accountability for the implementation and production roll out of the solutions and training of the production staff for steady state assistance. The solution delivered need to be adoptable in various markets, resilient, scalable, secured and with high performance that meet all the functional and non-functional requirements.

Responsibilities:

• Design and develop data ingestion and processing/transformation frameworks leveraging GCP core and related technologies
• Architectural design and solution implementation of large-scale operational and analytic use cases
• Design, develop, and integrate ETL/ELT data pipelines
• Actively participate in addressing non-functional requirements such as performance, security, scalability, continuous integration, migration and compatibility
• Take ownership from design of the feature through first lines of code to how it performs in production (you build it, you run it)
• Ensure fully automated testing by designing and writing automated unit, integration and acceptance tests

Qualifications, Skills and Experience:

• BS/MS in computer science or equivalent technical experience
• Strong coding skills in Scala language with the Spark framework, as well as some experience with Shell Scripting languages
• Experience developing in some or all of: Databricks, Google Cloud products, Pub/Sub, Kafka
• A coding background in either Java or R
• Experience in API development, API product expertise, API design patterns, and API Security (API Key Validation, Authentication, Authorization and Identity)
• Knowledge of big data open source technologies such as Hadoop, Workflow Managers such as NiFi, Kafka, Druid, Hive, Storm, Ignite, Kudu
• Minimum of 2 to 3 years of development experience handling variety of data (structured/unstructured), data formats (flat files, XML, JSON, relational, legacy) and data storage (Big Query, HDFS, Hbase, NoSQL databases)
• Experience in developing batch and real time data streams to create meaningful insights and analytics
• Strong understanding of different file formats (e.g. AVRO, ORC, Parquet, etc..) and data sources moving data into and out of HDFS.
• Good knowledge of issue tracking (Jira), source code management (Bitbucket), Continuous Integrations tools (Jenkins), Linux/Mac OS administration, build tools, package management and testing framework

Technologies you will use:

• Spark , Scala
• Google Cloud Products
• Data Bricks
• Pub/Sub, Kafka
• Big query
• Hadoop, Hive, Hbase
• Control M, Cloud Composer
• DevOps /terraform

About Adastra

At Adastra, we transform the Data & Analytics space by providing smart services and solutions in Artificial Intelligence, Big Data, Cloud, Digital and Governance. Our Consultants collaborate across functions, competencies and sectors to tackle the most interesting and complex data-related challenges, working closely with our clients to help them protect existing data investments, harness their data assets and unlock their business value by leveraging the most advanced tools, technologies, and methodologies available.

With over 20 years of experience in the industry, Adastra Group today has over 2,500 employees actualizing projects around the world from 11 global branches.

What We Offer

• Opportunity for advancement and career progression
• Competitive compensation package
• Comprehensive benefits plan
• Successful referral program
• The opportunity to work with one of Canada’s 50 Best Managed Companies
• Satisfaction of working for a reputable company
• A flexible, dynamic, and diverse workplace

There has been an increased instance of fraudulent job offers coming from people posing as Adastra HR employees. Please note that Adastra will never request fees as part of our recruiting process and any emails sent to you that are not from ‘@adastragrp.com’ or ‘@talent.icims.com’ are fraudulent. All employment offers are sent via DocuSign and if you receive an employment offer from a suspicious email and not via DocuSign, it is fraudulent.

Contact careers@adastragrp.com to inquire about jobs at Adastra, to report a suspicious request for money or personal information from external websites or suspicious employment offers.

Equal Opportunity Employer

In our commitment to promote fair and equitable treatment of all employees and applicants, Adastra Corporation provides equal employment opportunities for all individuals regardless of age, sex, disability, race, ethnic origin, citizenship, creed, sexual orientation, marital status or any other ground as described in the Ontario Human Rights Code. In addition, accommodation will be provided during the hiring process. Adastra Corporation’s implementation and support of employment initiatives, encourage diversified labour force participation and equal access to opportunities based on merit and performance.