engineer devops docker aws machine learning
Role details
Job location
Tech stack
Job description
Overview: We are looking for a Staff Data Engineer to transform millions of data points into unparalleled opportunities - supporting everything from electing Democrats to combating climate change throughout the world. With us, you'll put your skills to use for disruptive innovation that powers social good.
You'll join a product team that is deeply devoted to inclusion, particularly in the following three areas:
Process: We create a context in which everyone is empowered to contribute.
Machine Learning: We are committed to using the power of data to support important causes.
Philanthropy: We empower diverse groups of individuals to participate in giving.
We want your ideas and your leadership. Join us. Let's go! Successful candidates will be responsible for:
- Solving our unique data-lake challenges: transforming and seamlessly normalizing highly varied partner datasets (such as donation data);
- Design robust batch-processing pipelines capable of extracting and loading massive datasets from a variety of internal, external, and public sources;
- Developing processes for data mining, data modeling, and data production;
- Leveraging modern technology knowledge to champion evolving industry trends, updated design patterns, and engineering excellence across the team;
- Autonomously scope, design, and execute complex data projects from day one, turning ambiguous requirements into clear, decisive technical plans;
- Developing robust testing and monitoring systems for scheduled processes;
- Collaborating with cross-functional teams to support their data infrastructure needs; and
- Joining each and every one of your colleagues in creating an inclusive workspace.
Requirements
- 5 years of professional software engineering experience;
- Eagerness to mentor and technically guide engineering teams;
- Experience guiding technical decision making;
- Extensive, hands-on experience building distributed data pipelines using Apache Spark;
- Knowledge of how to build and optimize data pipelines, architectures and data sets with the ability to drive additional learning for knowledge gaps;
- Experience managing data warehouses and/or data lakes;
- Intellectual curiosity to innovate on ways to solve data management issues; and
- Passion, energy, and excitement for progressive and philanthropic causes.
Nice-to-have Qualifications:
- Experience training or using machine learning models;
- Experience in key DevOps/Infrastructure technologies such as AWS, GitHub Actions, Terraform, and Docker;
- An eagerness to lead and take ownership of complex projects;
- Experience mentoring or managing engineers; and
- Experience working with cross-functional teams in a dynamic environment.
Benefits & conditions
Expected hiring range for this role is $130,000 - $150,000 per year, depending on experience., 100% employer-paid premiums for platinum-level medical plan on a national health care network
100% employer-paid life insurance and short term disability
50% employer-paid vision and dental insurance
401(k) with 3% employer contribution
20 vacation days in addition to 12 paid holidays, sick days, bereavement leave, and a volunteer day off.
Paid parental leave at 100% of your salary
Financial support for reproductive and transgender care
Flexible telecommute and remote work policies
Company issued Mac products for home offices
Cell phone service reimbursement, meal and ride-share reimbursement, and other perks available
*Supporting your team on some nights and weekends as we approach high-volume times such as elections may be required.