Overview As an Infrastructure Engineering Advisor, you design and operate Kafka-based data pipelines to enable real-time data processing. You will work with application partners to define integration patterns, optimize and secure infrastructure, and automate day-to-day operations. This role blends on-prem and cloud (AWS/Azure) delivery, focusing on reliability, security, and scalable data architectures. You will contribute to platform roadmaps and support cross-functional teams to drive operational excellence.
Compensation / Benefits- medical, vision, dental
- 401(k)
- life insurance
- tuition reimbursement
- paid time off
- paid holidays and leaves
Responsibilities- Configure, deploy, and monitor Kafka clusters
- Collaborate with application partners to define integration patterns and solutions
- Optimize configurations for efficiency, reliability, and security
- Automate day-to-day operations to reduce manual effort
- Diagnose and resolve errors promptly to avoid customer impact
- Operate in a hybrid work schedule
Key requirements- Bachelor's degree in Computer Science, Computer Engineering or related field
- 3 years of Kafka systems administration experience
- Kafka cluster build, HA and DR design and planning
- SSL for wire encryption, SASL/LDAP for authentication, Kafka ACLs in Zookeeper
- Kafka Connect cluster and connector deployment
- Schemas and Schema Registry
- Ongoing Kafka maintenance: upgrades, tuning, monitoring, feature additions
- Proof of concept installation and testing
- Kafka in On-Premises and Cloud AWS
- Production readiness: build path, performance and resiliency testing, vulnerability remediation
- Roadmap implementation with product owners
- AWS or Azure resource provisioning; EC2, EBS, security groups
- Networking, load balancing, Okta integration
- Automation using shell scripting, Ansible, and Terraform
- collaboration
- problem solving
- communication
- Kafka (cluster build, HA, DR)
- SSL/TLS and SASL/LDAP for security
- Kafka ACLs in Zookeeper
