> Markdown version of [/jobs/ext/1893498-streaming-data-engineer](https://www.wearedevelopers.com/jobs/ext/1893498-streaming-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Streaming Data Engineer - **Company:** Bright Vision Technologies - **Location:** Sunnyvale, CA, United States (Remote available) - **Experience:** Expert - **Salary:** $78,000.0 - $105,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, User Authentication, Microsoft Azure, Bash Shell, Cloud Computing, Code Review, Data Governance, DevOps, Python (Programming Language), Role-Based Access Control, Site Reliability Engineering Practices, Ansible, Software Engineering, Data Streaming, Datadog, Scripting, Kubernetes, Information Technology, Apache Flink, Apache Kafka, Spark Streaming, Terraform, Stream Processing, Confluent - **Published:** July 31, 2026 - **Apply:** https://www.careerbuilder.com/job-details/streaming-data-engineer-sunnyvale-ca--ab023133-275d-4c94-900a-4c63f49ed2bb ## About the Role Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position., track record of shipping meaningful work that holds up well in production., * Bachelor's degree in Computer Science, Engineering, or a related technical discipline. * Five or more years of experience operating Apache Kafka or Confluent Platform in production. * Deep, hands-on knowledge of Kafka internals (partitions, replication, ISRs, consumer groups). * Strong experience with Kafka security (SASL, mTLS, ACLs, RBAC). * Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB. * Experience with HA/DR strategies for Kafka. * Strong scripting skills in Python, Bash, or Go. * Hands-on experience with infrastructure-as-code (Terraform, Ansible). * Working knowledge of observability tooling for Kafka. * Excellent troubleshooting, communication, and documentation skills. Preferred Qualifications * Confluent Certified Administrator or Developer credentials. * Experience operating Kafka on Kubernetes (Strimzi, Confluent Operator). * Exposure to managed Kafka services (AWS MSK, Azure Event Hubs Kafka API). * Familiarity with stream processing frameworks (Flink, Spark Streaming). * Experience with data governance and lineage for streaming data., Amazon Web Services (AWS), Ansible, Apache Kafka, Artificial Intelligence (AI), Automation, Bash Scripting, Cloud Computing, Code Reviews, Communication Skills, Computer Science, Consulting, Cross-Functional, DevOps, Documentation, EAD, High Tech Industry, Hubs, Identify Issues, Machine Tool, Mentoring, Microsoft Windows Azure, Product Design, Python Programming/Scripting Language, Replication and Remote Mirroring, SASL (Simple Authentication and Security Layer), Scripting (Scripting Languages), Software Development, Technical/Engineering Design ## Description We are seeking an experienced Streaming Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments supporting mission-critical event-driven workloads. In this role you will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement. The ideal candidate will combine deep Kafka internals knowledge with strong DevOps and SRE practices, and will partner with application teams to deliver a reliable, performant, and developer-friendly streaming platform. In this role you will work closely with cross-functional partners - product, design, engineering, operations, and business stakeholders - to translate ambiguous requirements into well-engineered solutions, and will be expected to raise the bar through code review, design review, and mentorship of more junior engineers. The successful candidate brings strong engineering discipline, a clear communication style, and a ## Related Videos - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Debugging in the Dark](https://www.wearedevelopers.com/videos/1658-debugging-in-the-dark) - [Dev & Test in the Cloud? Deploy your cloud environments with Ansible & Terraform](https://www.wearedevelopers.com/videos/1607-dev-test-in-the-cloud-deploy-your-cloud-environments-with-ansible-terraform) - [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions) - [#90DaysOfDevOps - The DevOps Learning Journey](https://www.wearedevelopers.com/videos/548-90daysofdevops-the-devops-learning-journey) - [Software Engineering Social Connection: Yubo’s lean approach to scaling an 80M-user infrastructure](https://www.wearedevelopers.com/videos/1583-software-engineering-social-connection-yubo-s-lean-approach-to-scaling-an-80m-user-infrastructure) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)