- Company Name
- SysTechCorp Inc
- Job Title
- Senior Software Engineer
- Job Description
-
Job Title: Senior Kafka Developer
Role Summary: Senior architect responsible for design, development, and operation of high‑throughput, fault‑tolerant streaming pipelines using Apache Kafka. Leads end‑to‑end lifecycle from producer/consumer coding to cluster monitoring and performance tuning within enterprise and cloud environments.
Expectations: • Deliver scalable event‑driven solutions that meet strict latency, throughput, and reliability targets. • Communicate complex Kafka design decisions to cross‑functional teams and stakeholder groups. • Maintain rigorous security, data integrity, and compliance across distributed data streams.
Key Responsibilities:
- Design and implement Kafka‑based data pipelines, including custom producers, consumers, stream processors, Kafka Connect connectors, and Schema Registry integration.
- Architect and maintain Kafka clusters (standalone or Confluent Platform) for enterprise workloads, ensuring high availability and optimal performance.
- Optimize cluster metrics (throughput, latency, fault tolerance) and troubleshoot production issues.
- Ensure message security, delivery guarantees, and data governance across distributed systems.
- Collaborate with DevOps to build CI/CD pipelines, containerize applications with Docker, orchestrate via Kubernetes, and support automated deployments.
- Integrate Kafka pipelines with microservices, enterprise systems, and cloud platforms using Java (Spring Boot) or Python.
Required Skills:
- 10+ years of backend development with 5+ years focused on Kafka architecture and development.
- Hands‑on design and implementation of Kafka producers, consumers, Streams, Connect, and Schema Registry.
- Experience with Zookeeper, Confluent Platform, and real‑time analytics pipelines.
- Proficient in Java (Spring Boot) or Python for stream processing and application development.
- Strong understanding of cluster monitoring, performance tuning, and fault‑tolerance strategies.
- Experience with CI/CD, Docker, Kubernetes, and cloud‑native deployment practices.
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Software Engineering, or related technical field.
- Certifications such as Confluent Certified Developer (CCDP) or Confluent Certified Administrator (CCA) are preferred.