Senior Data Engineer
Role details
Job location
Tech stack
Job description
We're looking for exceptional data engineers who have a strong background in distributed data processing, have great and demonstrable data intuition, and share our passion for continuously improving the ways we use data to make the Apple's products, applications, and platform secure, safe, and better.","responsibilities":"Engineer efficient, adaptable and scalable data pipelines to process structured and unstructured data
Own and evolve extremely rich datasets to power a wide variety of use cases for security posture
Build forward-looking data solutions that interface well with existing systems and use judgement to bring cutting edge technologies in the industry to suit security needs
You will be accountable to produce quality software that meet service level objectives
Participate in code and security reviews to help your peers to meet high standards for infrastructure at Apple
Research, prototype, and present ideas and designs to your team, management, and internal customers
Requirements
Do you have experience in Schema design?, Do you have a Bachelor's degree?, Experience with Cloud Computing platforms like Amazon AWS, Google Cloud
Experience with OSI model and understanding of how network works (Load Balancer, Routers, network tagging, NetFlow)
Understanding of the full technology stack (from BMCs, Firmware, to OS layer, to containers and applications) primitives
Experience with building stream-processing applications using Apache Flink, Spark-Streaming, Apache Storm, Kafka Streams or others
Experience with Search systems (such as ElasticSearch, Solr), NoSQL datastores (such as HBase, Cassandra, MongoDB)
Experience building distributed, high-volume data services
Minimum Qualifications
8+ years of experience working with Spark and other distributed data technologies (e.g. Hadoop, Presto, Flink, Druid) for building efficient & large scale data pipelines
Highly proficient in at least one of Java, Python or Scala
Deep expertise in Data Principles, Data Architecture & Data Modeling, Strong SQL skills
Familiar with AWS cloud resources (S3, EC2, RDS etc)
MS or BS or equivalent experience in Computer Science, Engineering, Mathematics, Statistics or a related field OR equivalent practical experience in Software or Data Engineering