Sr. / Staff Software Engineer, Data Lakehouse, Apple Data Platform

Apple Inc.
Seattle, WA, United States
13 days ago
Apply on www.seattlejobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Amazon Web Services Amazon S3 Apache HTTP Server Computing Platforms Big Data Data Infrastructure Software Debugging Distributed Systems Identity and Access Management Machine Learning
+10 more
Open Source Technology Data Ingestion Apache Spark Siri Kubernetes Information Technology Apache Flink Apache Kafka Data Lakehouse AWS EKS

Job description

The Apple Data Platform team, part of the Services organization, powers analytics and machine learning across Apple. Our mission is to deliver cutting-edge, reliable, and user-friendly infrastructure for data ingestion, storage, processing, and interaction, enabling teams to build data-intensive applications with ease and success. This role sits within the Data Lakehouse team, a part of the Apple Data Platform. The team provides a fully managed Lakehouse solution powered by Apache Iceberg, Iceberg REST Catalog, and custom-built services to manage data at scale. Our platform supports both analytical and machine learning workloads across Apple, serving key products and organizations including Siri, Search, Media, iCloud, News, Apple Intelligence, and Maps. We continuously innovate to meet evolving customer needs and market trends. We seek engineers passionate about building world-class infrastructure products. In this role, you will lead the data lakehouse team, guiding team members in both technical and professional growth. You will collaborate closely with cross-functional teams to lead the planning, execution, and success of technical projects, with a focus on enhancing the experience for Apple’s internal customers.

Requirements

The ideal candidate will have outstanding communication skills, proven data infrastructure/platform design and implementation capabilities, strong business acumen, and an innate drive to deliver results. He/she will be a self-starter, comfortable with ambiguity and will enjoy working in a fast-paced dynamic environment., * 10+ years of experience in design and development of scaling, and operation of distributed systems, including technologies like Apache Spark, Kafka, Flink, and Iceberg, along with resource management systems like Kubernetes or AWS EKS.

  • Proficient in Java or Scala.
  • Proficient in Apache Iceberg and Iceberg Rest Catalog specification
  • Proven expertise in designing and developing scalable, reliable APIs.
  • A hands-on approach with a willingness to engage in daily technical work.
  • Contributions to Open-Source projects like Apache Iceberg are a plus.
  • Skilled at debugging complex issues in large-scale distributed systems.
  • Driven by a passion for building reliable, maintainable, and user-friendly products and services.
  • Exceptional communication and collaboration skills, with the ability to work effectively across multiple teams and functions.
  • Bachelor’s, Master’s, or Ph.D. in Computer Science or a related technical discipline., * Expertise in public cloud platform’s like AWS, S3, EKS, IAM.
  • Contributor to open source technologies like Spark or Iceberg.
  • Expertise in building Lakehouse for large scale data platforms.
  • Experience with development of Iceberg Rest Catalogs like Apache Polaris, Graviton etc.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.seattlejobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

1:16 min

Evaluating the enduring financial and technological legacy of Apple

Marco Landi · World Congress 2024

3:49 min

Container hosting options available on Amazon Web Services

Federico Fregosi · World Congress 2022

2:14 min

Solving complex platform architecture challenges at an enterprise scale

Maria Apazoglou · Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all

Related articles

See all