{"@context":"https://schema.org","@graph":[{"@context":"https://schema.org/","@type":"JobPosting","@id":"#jobPosting","title":"Senior Software Engineer
Role details
Job location
Tech stack
Job description
- Enhance and maintain our open web crawling system, solving edge cases such as paywalled or obfuscated content to ensure reliable and comprehensive data collection.
- Build and optimize internal tools and infrastructure that empower data scientists and analysts to access and explore large-scale data with speed and minimal friction.
- Support our transition from batch to real-time data processing, including the design and implementation of queue-based pipelines and event-driven architectures.
- Develop and maintain data integrations with key demand-side platform (DSP) partners, ensuring reliable and secure data delivery at scale.
- Work across the stack as needed, whether improving backend performance, helping with API design, or optimizing data workflows.
- Contribute to core engineering practices such as code reviews, testing, observability, and CI / CD to help grow a robust, maintainable codebase.
- Mentor junior engineers, shepherd projects from ideation to completion, and constantly improve processes.
Requirements
-
7+ years of experience building and maintaining production systems.
-
Successful experience as a senior / lead engineer with demonstrated mentoring, project management, and technical leadership skills.
-
Excellent Python skills with 5+ years of clean, maintainable, well-tested code.
-
Deep experience with AWS services (EC2, S3, Lambda, CloudWatch, ECS / Fargate) focused on building reliable, scalable infrastructure.
-
Strong understanding of relational databases, particularly PostgreSQL, and experience writing efficient queries and managing schema changes.
-
Deep experience with data pipelines or event-driven architectures, including message queue tools such as SQS, Kafka, or similar.
-
Excellent debugging and problem-solving skills, navigating ambiguity and prioritizing effectively.
-
Deep experience with CI / CD pipelines, version control such as Git, ensuring smooth development workflows.
-
Excellent communication and collaboration abilities within a small, cross-functional team.
-
Remote or virtual team experience and ability to work across time zones. Desirable Experience and Behaviors
-
Experience building or working with web crawlers at scale.
-
Exposure to data engineering or analytics workflows.
-
Interest or experience with ad tech ecosystems or external partner integrations.
-
Experience using agile project-management tools (Jira, Asana).
-
Bachelor's degree in Computer Science, Engineering, or related field.
-
Comfortable with on-call rotations and rapid response.
Benefits & conditions
- Competitive salary (see above).
- Health, dental, and vision benefits (US-based team only).
- Flexible working hours and remote options; Full-time, 1.0 FTE (37.5 hrs per week). Work overlapping US Central hours required.
- Professional development opportunities.
- Diverse and inclusive workplace committed to equality and belonging.
