Software Engineer - Data Platform Team

eightfold.ai
Santa Clara, CA, United States
1 day ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
$130,750.0 - $181,000.0
Working hours
Regular working hours

Tech stack

Clean Code Principles Amazon Web Services Data Analysis Computing Platforms Microsoft Azure Cloud Computing Data Infrastructure Data Integration Database Queries Distributed Systems Fault Tolerance Python (Programming Language)
+9 more
Data Processing Google Cloud Load Balancing Data Ingestion Autoscaling Flask (Web Framework) Core Data Data Pipelines Service Stack

Job description

Join Eightfolds core Data Platform team to design, develop, and maintain the large-scale software platforms that serve millions of users globally. In this critical role, you will leverage cutting-edge technologies to work on complex, high-performance distributed systems, ensuring our platform is resilient, scalable, and the foundational power for our entire product suite. What You will Own and Deliver

  • Platform Architecture & Design: Lead the design and evolution of our core data platform architecture, focusing on building distributed and resilient systems with built-in features for auto-scaling, fault tolerance, horizontal scalability, and load balancing.
  • Performance Engineering: Drive the scaling, optimization, and innovation of the Data Platform. This includes analyzing data processing workflows, implementing caching mechanisms, fine-tuning database queries, and proactively addressing performance bottlenecks for maximum efficiency and responsiveness.
  • Feature Expansion & Innovation: Continuously extend the platform’s capabilities by staying current with industry trends and emerging technologies. Conduct research and development for new data processing techniques and collaborate closely with stakeholders to implement features that meet evolving business and user needs.
  • System Operations: Diagnose and resolve complex problems within our distributed systems environment and support the seamless deployment and operation of our products across various environments.
  • Cross-Functional Collaboration: Partner with Engineering, Operations, Analytics, Marketing, and Business teams to ensure successful, end-to-end product development and delivery.
  • Cloud Stack Management: Work across major cloud platforms, specifically AWS and Azure.

Requirements

  • 2-6 years of professional experience in building core features of highly scalable data platform.
  • Proven experience in building highly available distributed systems.
  • Working experience in high-volume data pipelines, data ingestion and data integration.

Technical Expertise:

  • Expertise in building and optimizing high-performance, high-throughput systems.
  • Proficiency with core backend technologies including AWS, Python, and the Flask Framework.
  • Strong foundational understanding of distributed system design principles.
  • Proven experience with cloud platforms (AWS, Azure, GCP).

Mindset & Skills:

  • Excellent analytical and complex problem-solving skills, particularly with data analysis.
  • A proactive attitude with a strong sense of ownership to rigorously chase down complex problems to the root and deliver permanent fixes.
  • Ability to thrive in a fast-paced environment, handling context-switching effectively, and a genuine desire to solve real Customer problems.
  • Commitment to high-quality code and a drive to ship features quickly and reliably.

Benefits & conditions

Pay Transparency. Please note this role is categorized as hybrid in Santa Clara, CA The base salary ranges below are provided for pay transparency. Base pay is only one piece of our total compensation package as this role is eligible for bonus and equity awards. Compensation varies depending on a number of factors including qualifications, skills, competencies, experience and zones determined by location. SF Bay Area, CA is in Zone A. Base annual salary range in Zone A: $130,750 to $181,000 USD + discretionary bonus up to 10% + preIPO equity (stock options). Hybrid Work. At Eightfold, we believe our best work happens when we collaborate closely, learn from one another, and build together. We follow a hybrid work model that combines flexibility with a strong emphasis on in-person collaboration to foster innovation, culture, and rapid execution. Employees based near our Santa Clara office are expected to work from the office 3 days per week, as we believe regular in-person engagement is essential to how we build high-impact products and strong teams. Eightfold.ai provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, veteran or disability status. Experience our comprehensive benefits with family medical, vision and dental coverage, a competitive base salary, and eligibility for equity awards and discretionary bonuses or commissions. #LI-Hybrid

Santa Clara, CA, USA Software Engineer - Data Platform Team Lunch: Free Catered Meals Vacation: Unlimited PTO Insurance: Medical, Vision, Dental 401k: 401k provided hybrid

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on app.eightfold.ai

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:21 min

Challenges of traditional mobile data synchronization

Timothy Marland · WWC 2023

3:33 min

Managing node capacity with default cluster autoscaling

Mario-Leander Reimer · WWC 2023

6:10 min

Unlocking free learning credits via Google Cloud Innovators

Asrar Asrar · WWC 2024

2:14 min

Solving complex platform architecture challenges at an enterprise scale

Maria Apazoglou · Coffee With Developers

2:57 min

Core data types and collection structures in Clojure

Tobias Schröder · WWC 2021

Videos

See all

Related articles

See all