> Markdown version of [/jobs/ext/2110561-principal-software-engineer-data-platform-prisma-airs](https://www.wearedevelopers.com/jobs/ext/2110561-principal-software-engineer-data-platform-prisma-airs). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Software Engineer (Data Platform Prisma AIRS) - **Company:** Palo Alto Networks - **Location:** Santa Clara, CA, United States - **Experience:** Expert - **Salary:** $147,000.0 - $237,500.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Big Data, BigQuery, Computer Programming, Directed Acyclic Graph (Directed Graphs), Data Infrastructure, Distributed Systems, Fault Tolerance, Data Flow Control, Python (Programming Language), Machine Learning, Open Source Technology, Reliability Engineering, Cloud Services, Security Software, Data Processing, Multi-Agent Systems, Apache Spark, Backend, Kubernetes, Information Technology, Apache Kafka, Terraform, Apache Beam, Golang - **Published:** August 19, 2026 - **Apply:** https://www.techcareers.com/job.asp?id=3358967510&tx=CT2624TYZ&pt=1&aff=0B19D771-A501-4A5E-8338-2A822B784D54&utm_source=Job%20Feed&utm_medium=textkernel&utm_campaign=DE&utm_term=0B19D771-A501-4A5E-8338-2A822B784D54 ## About the Role * Bachelor's degree in Computer Science or a related field with 10+ years of relevant industry experience, or a Master's degree with 8+ years of experience. * Deep domain expertise in designing, building, and operating highly scalable, fault-tolerant distributed systems, with exceptional programming skills in Golang and Python. * Hands-on experience building backend data platform infrastructure using distributed execution engines such as Apache Beam or Apache Spark. * Hands-on experience architecting, building, or deploying complex agentic workflows, tool-use pipelines, or multi-agent orchestrations within data infrastructure. * Proven track record of profiling, benchmarking, and tuning high-throughput distributed pipelines to improve latency and resource efficiency. * Broad experience with cloud-native data stacks (GCP/Dataflow preferred), messaging (Pub/Sub, Kafka), storage engines (BigQuery, Iceberg), and infrastructure tooling (Kubernetes, Terraform). * Demonstrated ability to drive consensus across multi-team boundaries, solve complex technical problems, and mentor senior engineering talent., * Active contributions or committer status in open-source big data projects (Apache Beam, Spark, Airflow, Iceberg, etc.). ## Description As a Principal Software Engineer, Data Platform on the Prisma AIRS Runtime Security team, you will serve as a technical visionary and strategic leader shaping the future of our enterprise data infrastructure. You will partner with executive leadership, product management, ML engineers, data scientists, and cross-functional software teams to conceptualize, architect, and deliver cutting-edge, enterprise-grade distributed processing solutions. You will be at the vanguard of innovation for our platform in the rapidly evolving space of real-time streaming and high-throughput batch data processing. Your responsibilities will transcend traditional pipeline development to lead continuous performance and efficiency optimizations, enabling multi-source data ingestion and transformation to power AI model lifecycle workflows, operational analytics, and automated security policy recommendations. You will drive technical excellence across the organization, set architectural standards, and act as a force multiplier by mentoring other engineers on the team., * Partner with Product Management, SRE, ML Engineering, Security Researchers, and Quality Engineering to design and deliver high-throughput data platform capabilities and streaming services. * Architect and build resilient, multi-source batch and streaming engines to power analytical workflows, business insights, and internal feature improvements. * Profile, benchmark, and tune distributed execution DAGs, state storage, and compute resources to maximize throughput, lower processing latency, and optimize cloud expenditure at scale. * Evangelize and implement modern software engineering best practices, including spec-driven development, comprehensive testing frameworks, and agentic coding workflows. * Act as a force multiplier by mentoring senior and junior engineers, conducting rigorous architectural reviews, and cultivating a culture of technical excellence across the team. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [Scoring 2000 Products per Request: Performance Pitfalls in Golang](https://www.wearedevelopers.com/videos/2073-scoring-2000-products-per-request-performance-pitfalls-in-golang) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)