Event Streaming Engineer - Kafka / Azure Event Hubs

Job summary

Design and implement event-driven integrations using Azure Event Hubs and Apache Kafka, including topic and schema management, security controls, and downstream consumer connections. Build reliable integrations with retry, recovery, duplicate handling, and replay, and establish monitoring, alerting, runbooks, documentation, and end-to-end testing.

Job details

About the Role We are looking for a Senior Event Streaming Engineer / Lead to design and implement event-driven integration solutions using Azure Event Hubs and Apache Kafka. Responsibilities Design event-driven integrations, including Kafka connectivity, topic mapping, partitioning, and schema management. Configure Event Hubs, partitions, consumer groups, retention, and throughput settings in collaboration with Cloud Engineering. Implement secure authentication, Microsoft Entra ID, RBAC, and least-privilege access controls. Develop event ingestion and downstream consumer integrations using Kafka-compatible interfaces or Azure SDKs. Implement retry, recovery, duplicate handling, replay, and end-to-end reliability testing. Establish monitoring, alerting, operational runbooks, and technical documentation. Required Skills Hands-on experience with Azure Event Hubs and Apache Kafka. Strong knowledge of Kafka producers, consumers, topics, partitions, offsets, and delivery semantics. Experience with event-driven architecture, serialization, and schema compatibility. Practical knowledge of Azure security, identity, RBAC, and credential management. Ability to independently design, develop, troubleshoot, and test end-to-end integrations. Preferred Skills C#/.NET development for Kafka integrations or bridge solutions. Experience with JSON, Avro, and schema registries. Familiarity with Azure Monitor, Log Analytics, Terraform/Bicep, and CI/CD. Knowledge of high availability, disaster recovery, and production support. Azure or Kafka certifications are an advantage.

What you’ll do

Design and implement event-driven integrations using Azure Event Hubs and Apache Kafka, including topic and schema management, security controls, and downstream consumer connections. Build reliable integrations with retry, recovery, duplicate handling, and replay, and establish monitoring, alerting, runbooks, documentation, and end-to-end testing.

Requirements

Requires hands-on experience with Azure Event Hubs and Apache Kafka, strong knowledge of Kafka concepts and delivery semantics, and practical expertise in event-driven architecture, serialization, schema compatibility, and Azure security. The role also requires the ability to independently design, develop, troubleshoot, and test integrations; C#/.NET, schema registries, Azure monitoring, infrastructure as code, CI/CD, and relevant certifications are preferred or advantageous.

Listed skills

• CI/CD · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Azure Event Hubs
• Apache Kafka
• Event-Driven Architecture
• Kafka Producers and Consumers
• Topics and Partitions
• Offsets and Delivery Semantics
• Schema Management
• Azure Security
• Microsoft Entra ID
• Role-Based Access Control
• C#/.NET
• JSON and Avro
• Azure Monitor
• Log Analytics
• Terraform and Bicep
• CI/CD

Job areas

• Technology
• Software
• Engineering

More jobs from Coforge