About the role
Lead/Architect level requirement to assist on building out Kafka platform and specifically with focus on Flink; Should be able to contribute to design, propose, and evaluate solutions. Should also be hands-on with development and lead the Kafka development team.
Description
- Expert-level architecture and implementation experience of Flink applications on Confluent Platform, specifically for high-volume, low-latency stream processing.
- Extensive experience architecting, implementing, and administering the Confluent Cloud Kafka and Flink platform in production environments.
- Advanced proficiency in core Flink concepts including state management (Keyed/Operator State, RocksDB), Exactly-Once semantics, and configuring checkpointing and savepoints for fault tolerance.
- Deep knowledge of Event Time processing, Watermarks (Bounded Out-of-Orderness), and complex Windowing(Tumbling, Sliding, Session) for accurate stream analytics.
- Advanced knowledge of KSQL DB and KStreams for rapid development of real-time stream processing/analytics alongside Flink.
- Proven proficiency in Kafka Connectors (including Change Data Capture/CDC) from configuration to end-to-end integration in cloud environments.
- Demonstrated experience applying Flink and Kafka in the Retail Industry for use cases such as real-time inventory management, dynamic pricing, fraud detection, and personalized customer experience (e.g., clickstream analysis).
- Strong background in platform governance: schema registry, RBAC, audit logging, retention, and compliance.
- Deep expertise with Terraform and the Confluent Terraform provider; adherence to Infrastructure-as-Code (IaC) methodology and automation.
- Practical experience designing and managing Harness CI/CD pipelines (or other similar tools) for automated deployment and configuration management of Flink jobs.
- Advanced knowledge of GCP networking, including Private Service Connect (PSC), DNS, Firewalls, and enterprise security.
- Track record in implementing cloud-native monitoring and observability solutions; troubleshooting, Flink performance tuning, and incident response.
- Thorough experience with Disaster Recovery (DR), High Availability (HA) strategies, backup/restore, and multi-region design.
- Practical experience with cost optimization, resource monitoring, and right-sizing specifically for Flink and Kafka resources in Confluent Cloud.
- Strong abilities in schema management, version compatibility, and data governance.
- Demonstrated capability in capacity planning, partitioning, and scaling high-throughput streaming architectures.
- Experienced in Agile/DevOps methodologies.
- Experience providing hands-on production support for mission-critical streaming platforms.
About W3Global
W3Global is a leading provider of end-to-end consulting services, empowering businesses to achieve their strategic goals and optimize their operations. With over 15 years of experience, we have a proven track record of delivering innovative and effective solutions across a wide range of industries.
Our Mission
At W3Global, we are committed to helping businesses of all sizes achieve their full potential. We believe that by combining our deep industry expertise with our innovative approach, we can deliver exceptional results that exceed our clients' expectations.
Our Services
We offer a comprehensive suite of consulting services designed to address the specific needs of our clients. Our services include:
Strategy Consulting: We help businesses develop and implement winning strategies to achieve their long-term goals.
Business Process Improvement: We identify and optimize business processes to enhance efficiency, reduce costs, and improve customer satisfaction.
Technology Consulting: We provide expert guidance on technology selection, implementation, and integration to support business objectives.
Talent Acquisition: We help businesses find and hire the right talent to support their growth and success.
Human Capital Management: We provide comprehensive HR solutions to help businesses manage their workforce effectively.
About the role
Lead/Architect level requirement to assist on building out Kafka platform and specifically with focus on Flink; Should be able to contribute to design, propose, and evaluate solutions. Should also be hands-on with development and lead the Kafka development team.
Description
- Expert-level architecture and implementation experience of Flink applications on Confluent Platform, specifically for high-volume, low-latency stream processing.
- Extensive experience architecting, implementing, and administering the Confluent Cloud Kafka and Flink platform in production environments.
- Advanced proficiency in core Flink concepts including state management (Keyed/Operator State, RocksDB), Exactly-Once semantics, and configuring checkpointing and savepoints for fault tolerance.
- Deep knowledge of Event Time processing, Watermarks (Bounded Out-of-Orderness), and complex Windowing(Tumbling, Sliding, Session) for accurate stream analytics.
- Advanced knowledge of KSQL DB and KStreams for rapid development of real-time stream processing/analytics alongside Flink.
- Proven proficiency in Kafka Connectors (including Change Data Capture/CDC) from configuration to end-to-end integration in cloud environments.
- Demonstrated experience applying Flink and Kafka in the Retail Industry for use cases such as real-time inventory management, dynamic pricing, fraud detection, and personalized customer experience (e.g., clickstream analysis).
- Strong background in platform governance: schema registry, RBAC, audit logging, retention, and compliance.
- Deep expertise with Terraform and the Confluent Terraform provider; adherence to Infrastructure-as-Code (IaC) methodology and automation.
- Practical experience designing and managing Harness CI/CD pipelines (or other similar tools) for automated deployment and configuration management of Flink jobs.
- Advanced knowledge of GCP networking, including Private Service Connect (PSC), DNS, Firewalls, and enterprise security.
- Track record in implementing cloud-native monitoring and observability solutions; troubleshooting, Flink performance tuning, and incident response.
- Thorough experience with Disaster Recovery (DR), High Availability (HA) strategies, backup/restore, and multi-region design.
- Practical experience with cost optimization, resource monitoring, and right-sizing specifically for Flink and Kafka resources in Confluent Cloud.
- Strong abilities in schema management, version compatibility, and data governance.
- Demonstrated capability in capacity planning, partitioning, and scaling high-throughput streaming architectures.
- Experienced in Agile/DevOps methodologies.
- Experience providing hands-on production support for mission-critical streaming platforms.
About W3Global
W3Global is a leading provider of end-to-end consulting services, empowering businesses to achieve their strategic goals and optimize their operations. With over 15 years of experience, we have a proven track record of delivering innovative and effective solutions across a wide range of industries.
Our Mission
At W3Global, we are committed to helping businesses of all sizes achieve their full potential. We believe that by combining our deep industry expertise with our innovative approach, we can deliver exceptional results that exceed our clients' expectations.
Our Services
We offer a comprehensive suite of consulting services designed to address the specific needs of our clients. Our services include:
Strategy Consulting: We help businesses develop and implement winning strategies to achieve their long-term goals.
Business Process Improvement: We identify and optimize business processes to enhance efficiency, reduce costs, and improve customer satisfaction.
Technology Consulting: We provide expert guidance on technology selection, implementation, and integration to support business objectives.
Talent Acquisition: We help businesses find and hire the right talent to support their growth and success.
Human Capital Management: We provide comprehensive HR solutions to help businesses manage their workforce effectively.