Software Engineer - Data Infrastructure
Role details
Job location
Tech stack
Job description
Data represents the voice of Airbnb's users at scale. The Data Warehouse Infrastructure team is responsible for the foundational big data infrastructure, which is used by hundreds of engineers to collect, manage, and analyze data at scale. We are using open source technologies like Hadoop, Spark, Trino, Iceberg, Airflow etc.
A Typical Day:
- Architect, design, and implement Airbnb's next-generation big data compute platform to support data ETL, analytics, and machine learning initiatives.
- Manage and operate the platform, continually enhancing its reliability, performance, observability, and cost-efficiency.
- Produce high-quality, maintainable, and self-documenting code, actively participating in code review processes.
- Contribute to open-source software and drive meaningful industry impact.
Requirements
- Education: BS/MS/PhD in Computer Science, a related field, or equivalent practical experience (preferred).
- Experience: 6+ years of professional experience in data infrastructure, with a deep focus on big data technologies.
Technical Skills
- Big Data Proficiency: Expert-level knowledge of big data technologies, including Spark, Trino, Kunbernates, and AWS EMR.
- Programming: Strong programming abilities in languages such as Java, Scala, and SQL.
- System Design: Extensive experience in the design, construction, and maintenance of scalable, fault-tolerant distributed systems.
- Database Systems: Familiarity with a variety of database systems, including both SQL and NoSQL.
- Troubleshooting: Capacity to diagnose and resolve complex issues within data infrastructure environments.
Collaboration and Communication
- Collaboration: Proven track record of working effectively with cross-functional teams to define system requirements, evaluate potential solutions, and manage system testing and integration.
- Communication: Excellent written and verbal communication skills.
- Teamwork: Demonstrated ability to thrive and contribute effectively within a team-oriented setting.
Benefits & conditions
Our job titles may span more than one career level. The actual base pay is dependent upon many factors, such as: training, transferable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future. This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits., Our job titles may span more than one career level. The actual base pay is dependent upon many factors, such as: training, transferable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future. This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.
Pay Range
$191,000-$225,000 USD