[Remote] Cloud Engineer
Note: The job is a remote job and is open to candidates in USA. Astrally is seeking a Mid-Level Confluent Kafka Engineer for an engineering-focused role supporting enterprise Kafka and streaming data platforms. The role is responsible for designing, implementing, automating, and supporting secure, scalable, and highly available messaging platforms using Apache Kafka, Confluent Cloud, Terraform, and Apache Flink.
Responsibilities
- Responsible for designing, implementing, automating, and supporting enterprise Kafka and streaming data platforms
- Managing Kafka infrastructure
- Building streaming solutions
- Automating Confluent resources using Terraform
- Ensuring secure, scalable, and highly available messaging platforms
- Production administration and engineering experience
- Kafka clusters, topics, partitions
- Consumer groups and consumer lag monitoring
- ACL management and performance optimization
- Schema governance
- Compatibility modes
- Subject naming strategies
- Schema versioning and evolution
- Managing Kafka infrastructure through code rather than manual administration
- Flink SQL
- Stateful stream processing
- Windowing
- Performance tuning
- Checkpoints and Savepoints
- RBAC
- ACLs
- API Keys
- TLS
- Authentication & Authorization
- Audit logging
- Network security
- GitLab CI
- GitHub Actions
- Atlantis or similar tools
- Terraform Plan/Apply pipelines
- Drift detection
- Kafka producers/consumers
- Automation scripts
- Operational tooling
- Prometheus
- Grafana
- PagerDuty or equivalent
- Kafka lag monitoring
- Broker health monitoring
- Flink metrics and alerting
Skills
- Apache Kafka / Confluent Cloud (3–6 years)
- Production administration and engineering experience
- Kafka clusters, topics, partitions, replication
- Consumer groups and consumer lag monitoring
- ACL management and performance optimization
- Confluent Schema Registry
- Schema governance
- Compatibility modes
- Subject naming strategies
- Schema versioning and evolution
- Terraform / Infrastructure as Code
- Strong experience with Terraform
- Confluent Terraform Provider
- Managing Kafka infrastructure through code rather than manual administration
- Apache Flink / Confluent Managed Flink
- Flink SQL
- Stateful stream processing
- Windowing
- Performance tuning
- Checkpoints and Savepoints
- Kafka / Confluent Security
- RBAC
- ACLs
- API Keys
- TLS
- Authentication & Authorization
- Audit logging
- Network security
- CI/CD
- GitLab CI
- GitHub Actions
- Atlantis or similar tools
- Terraform Plan/Apply pipelines
- Drift detection
- Programming
- Python or Java
- Kafka producers/consumers
- Automation scripts
- Operational tooling
- Monitoring & Observability
- Prometheus
- Grafana
- PagerDuty or equivalent
- Kafka lag monitoring
- Broker health monitoring
- Flink metrics and alerting
- Apache Kafka: ______ Years
- Confluent Cloud: ______ Years
- Confluent Schema Registry: ______ Years
- Terraform (Infrastructure as Code): ______ Years
- Apache Flink: ______ Years
- Kafka/Confluent Security: ______ Years
- CI/CD (GitLab CI/GitHub Actions/Atlantis): ______ Years
- Python or Java: ______ Years
- Monitoring (Prometheus/Grafana/PagerDuty): ______ Years
- Experience supporting enterprise-scale streaming platforms
- Strong troubleshooting and production support skills
- Experience working in Agile environments
- Excellent communication and collaboration skills
Benefits
- Remote work arrangement, with travel to Richmond, VA twice per quarter for 3–5 business days
Company Overview