> Markdown version of [/jobs/ext/4618524-senior-staff-engineer-big-data-infrastructure-staff](https://www.wearedevelopers.com/jobs/ext/4618524-senior-staff-engineer-big-data-infrastructure-staff). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Staff Engineer, Big Data Infrastructure Staff - **Company:** LOOP LOOPS, INC. - **Location:** San Francisco, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Amazon S3, Big Data, Cloud Storage, Software Debugging, Distributed Systems, Apache Hive, SQL Databases, Apache Yarn, Apache Spark, Data Lakes, Stripe, Kubernetes - **Published:** November 7, 2026 - **Apply:** https://www.juju.com/job/28_25303_61b63aa46d9b1355c5b5ff335ffc871d ## About the Role * Airflow / orchestration Drive the architecture and delivery of critical modernization bets, including YARN to Kubernetes migrations, native vectorization (Gluten/Velox), and Airflow and Data Catalog modernization must have * Spark Experience with big data infrastructure at scale, such as Spark, Iceberg, S3, Airflow, YARN, and Celeborn must have * AWS Serve as the technical leader for the Big Data Infrastructure organization, overseeing distributed systems that manage 20% of Stripe's total AWS spend must have · not practised here * Drive the architecture and delivery of critical modernization bets, including YARN to Kubernetes migrations, native vectorization (Gluten/Velox), and Airflow and Data Catalog modernization must have · not practised here * Experience developing, maintaining, and debugging distributed systems while optimizing their reliability and security must have * Experience driving a culture of operational excellence, with a deep understanding of metrics, alerts, and dashboards * Data Lake (Iceberg, Hive, S3, Azure Blob Storage) not practised here * Warehousing Data Lake (Iceberg, Hive, S3, Azure Blob Storage) * Governance & security Drive the architecture and delivery of critical modernization bets, including YARN to Kubernetes migrations, native vectorization (Gluten/Velox), and Airflow and Data Catalog modernization not practised here * SQL Data Lake (Iceberg, Hive, S3, Azure Blob Storage) * Experience driving a culture of operational excellence, with a deep understanding of metrics, alerts, and dashboards not practised here