Senior Staff Engineer, Big Data Infrastructure Staff

LOOP LOOPS, INC.
San Francisco, CA, United States
1 day ago
Apply on www.juju.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Amazon S3 Big Data Cloud Storage Software Debugging Distributed Systems Apache Hive SQL Databases Apache Yarn Apache Spark Data Lakes
+2 more
Stripe Kubernetes

Requirements

  • Airflow / orchestration Drive the architecture and delivery of critical modernization bets, including YARN to Kubernetes migrations, native vectorization (Gluten/Velox), and Airflow and Data Catalog modernization must have
  • Spark Experience with big data infrastructure at scale, such as Spark, Iceberg, S3, Airflow, YARN, and Celeborn must have
  • AWS Serve as the technical leader for the Big Data Infrastructure organization, overseeing distributed systems that manage 20% of Stripe’s total AWS spend must have · not practised here
  • Drive the architecture and delivery of critical modernization bets, including YARN to Kubernetes migrations, native vectorization (Gluten/Velox), and Airflow and Data Catalog modernization must have · not practised here
  • Experience developing, maintaining, and debugging distributed systems while optimizing their reliability and security must have
  • Experience driving a culture of operational excellence, with a deep understanding of metrics, alerts, and dashboards
  • Data Lake (Iceberg, Hive, S3, Azure Blob Storage) not practised here
  • Warehousing Data Lake (Iceberg, Hive, S3, Azure Blob Storage)
  • Governance & security Drive the architecture and delivery of critical modernization bets, including YARN to Kubernetes migrations, native vectorization (Gluten/Velox), and Airflow and Data Catalog modernization not practised here
  • SQL Data Lake (Iceberg, Hive, S3, Azure Blob Storage)
  • Experience driving a culture of operational excellence, with a deep understanding of metrics, alerts, and dashboards not practised here

About the company

Stripe is a financial infrastructure platform for businesses. Millions of companies - from the world’s largest enterprises to the most ambitious startups - use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com
Prepare application

Good distractions

Loading talks and stories from around this role…