Jobs.ca
Jobs.ca
Language
CGI logo

Big Data Cloud Developer (Senior)

CGI12 days ago
Montréal, QC
Senior Level
full_time

About the role

As a Big Data Cloud Expert, you will be part of a global team, responsible for our Data Lake platform on Microsoft Azure. You will be the main contact for AMER region projects, supporting various business lines.

The platform uses Open-Source technologies like Spark and Kafka, as well as Azure-specific tools such as Azure Storage, HDInsight, Synapse, Fabric, and AKS. It is self-service, highly automated, and secure, ensuring stability for critical business processes.

Day-to-Day Responsibilities:

  • Identify future needs and design solutions.
  • Test and evaluate new Azure technologies with security and Microsoft teams.
  • Implement solutions, build automation, and monitor for stability.
  • Provide training on data best practices.
  • Assist data project teams with onboarding and transformation on Azure.
  • Train team members and advise on Big Data projects.
  • Participate in production support, including overtime and incident communication with AMER users.

Technical Stack:

JAVA | AZURE | SPARK | AKS - KUBERNETES | FABRIC.

Profile:

Skills and Qualifications:

Must Have:

  • 5+ years of experience in development and architecture with Java, including building multi-threaded applications and APIs.
  • Strong experience with Big Data technologies such as Hadoop, Kafka, Azure Kubernetes Service, and OpenTable formats like Delta or Iceberg.
  • Proficiency in Microsoft Azure cloud technologies, including Azure Storage, Azure Synapse, and Azure AI search.
  • Solid experience with Apache Spark.
  • Background in Oracle SQL, PostgreSQL, or similar RDBMS.

Nice to Have:

  • Working knowledge of Terraform and PowerShell/Bash.
  • Experience with Continuous Integration/Continuous Delivery using modern DevOps tools and workflows (Git, GitHub, Jira, Docker, Jenkins).
  • Bachelor's degree in Computer Science, DEC, or equivalent technical certifications.

Languages: French and English required.

Requirement:

  • Proficiency in English, both spoken and written, is essential for regular collaboration with colleagues and partners in the United States.

===========================================

En tant qu'Expert en Big Data Cloud, vous ferez partie d'une équipe mondiale responsable de notre plateforme Data Lake sur Microsoft Azure. Vous serez le principal contact pour les projets de la région AMER, soutenant diverses lignes de métier.

La plateforme utilise des technologies open-source comme Spark et Kafka, ainsi que des outils spécifiques à Azure tels que Azure Storage, HDInsight, Synapse, Fabric et AKS. Elle est en libre-service, hautement automatisée et sécurisée, garantissant la stabilité des processus métiers critiques.

Responsabilités quotidiennes:

  • Identifier les besoins futurs et concevoir des solutions.
  • Tester et évaluer les nouvelles technologies Azure avec les équipes de sécurité et Microsoft.
  • Implémenter des solutions, automatiser et surveiller pour assurer la stabilité.
  • Fournir des formations sur les meilleures pratiques en matière de données.
  • Aider les équipes de projets de données à s'intégrer et à se transformer sur Azure.
  • Former les membres de l'équipe et conseiller sur les projets Big Data.
  • Participer au support de production, y compris les heures supplémentaires et la communication sur les incidents avec les utilisateurs AMER.

Pile technique:

JAVA | AZURE | SPARK | AKS - KUBERNETES | FABRIC

Profil:

Compétences et qualifications:

Indispensable:

  • Plus de 5 ans d'expérience en développement et architecture avec Java, y compris la création d'applications multi-thread et d'API.
  • Solide expérience avec les technologies Big Data telles que Hadoop, Kafka, Azure Kubernetes Service et les formats OpenTable comme Delta ou Iceberg.
  • Maîtrise des technologies cloud Microsoft Azure, y compris Azure Storage, Azure Synapse et Azure AI search.
  • Expérience solide avec Apache Spark.
  • Connaissance des bases de données Oracle SQL, PostgreSQL ou similaires.

Souhaitable:

  • Connaissance pratique de Terraform et PowerShell/Bash.
  • Expérience en intégration continue/livraison continue avec des outils et workflows DevOps modernes (Git, GitHub, Jira, Docker, Jenkins).
  • Diplôme en informatique, DEC ou certifications techniques équivalentes.

Langues: Français et anglais requis.

Exigence:

  • La maîtrise de l'anglais, tant à l'oral qu'à l'écrit, est essentielle pour une collaboration régulière avec des collègues et des partenaires aux États-Unis.

About CGI

IT Services and IT Consulting
10,000+

Insights you can act on to achieve trusted outcomes.

We are insights-driven and outcomes-focused to help accelerate returns on your investments. Across 21 industry sectors and 400 locations worldwide, we provide comprehensive, scalable and sustainable IT and business consulting services that are informed globally and delivered locally.

We value your opinions and welcome your comments and questions on our posts here on LinkedIn. Please keep a polite, professional and constructive tone. We remove comments containing objectionable language and derogatory views. We do not allow content that is unrelated to the subject, and we remove discriminatory and racist comments as well as spam and advertising.

Note that content on this page contains general information regarding CGI’s services and initiatives and should not be considered direct business advice. To engage in a discussion with one of our experts, please make a request through https://www.cgi.com/en/contact-us