Job Overview
We are seeking a Software Engineer with demonstrable expertise in Apache Flink and Apache Kafka to support and extend a large-scale enterprise streaming platform. The role focuses on enhancing the existing Kafka ecosystem with advanced filtering, payload projection and topic joins implemented via Flink SQL, and on preparing production-ready deployments using Kubernetes.
Responsibilities
- Design and implement a Flink SQL filter-rule framework and associated validation tooling.
- Develop a Kafka Connect Single Message Transform (SMT) plugin to perform XML-to-Avro transformations.
- Define and deliver consumer self-service YAML schema templates and PR workflows to streamline onboarding.
- Integrate producers and consumers with Confluent Schema Registry and ensure robust Avro schema evolution practices.
- Prepare and maintain deployment manifests leveraging the Flink Kubernetes Operator; support Kubernetes deployment and runtime troubleshooting.
- Collaborate with the MEP team on architecture decisions, code and design reviews, and operational readiness.
- Contribute to topic and consumer group management practices and operational playbooks for stateful stream processing.
Qualifications
- Strong practical experience with Apache Flink, including Flink SQL (filter expressions, projections, window joins).
- Experience operating Flink on Kubernetes, preferably with the Flink Kubernetes Operator.
- Solid understanding of stateful stream processing concepts and related operational concerns.
- Hands-on experience with Apache Kafka and/or Confluent Platform, including producer/consumer models and topic/consumer group management.
- Experience with Kafka Connect (source and sink connectors) and development or customization of SMTs.
- Familiarity with Confluent Schema Registry, Avro schema design and schema evolution strategies.
- Practical experience deploying and troubleshooting applications on Kubernetes.
- Fluent English (spoken and written).
Nice to Have
- Knowledge of AsyncAPI v3 for event-driven documentation.
- Experience developing custom Kafka Connect SMTs in Java.
- Previous implementation of XML-to-Avro transformation logic.
- Familiarity with GitOps, CI/CD workflows and YAML-based configuration management.
- Working knowledge of Flink Table API.
- Experience with agentic engineering or AI-assisted delivery lifecycles.
Benefits
- Remote working.
- Unique TEAL culture, relationship- and respect-driven community, non-corporate atmosphere.
- Agile approach and no bureaucracy.
- Outstanding integration trips to various places in Europe for all employees.
- Activities to support your well-being and health.
- Luxmed Gold Extended medical care and Multisport Plus benefit.