Data Engineer (Software Developer 2)

Stanford University
Palo Alto, CA, United States
5 days ago
Apply on www.adzuna.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Airflow Amazon S3 C++ (Programming Language) Extract Transform Load (ETL) Python (Programming Language) NoSQL Standard Sql Scientific Computating SQL Databases Management of Software Versions
+8 more
Workflow Management Systems Ceph (Software) Agentic-AI Kubernetes Data Lineage Build Tools Data Pipelines Docker

Requirements

performance across the data stack, and lead troubleshooting/incident response when things break + Build tools with and to help researchers and our in-house AI agents discover datasets, inspect processing state, and safely diagnose or rerun failed jobs + Productionize research code - testing, packaging, deployment, monitoring, documentation + Partner with data acquisition, infrastructure engineering, scientific analysis and AI modeling teams. Preferred Qualifications: + Strong proficiency in Python and SQL + Experience with relational and NoSQL databases, as well as object storage (e.g., S3, MinIO, Ceph) + Experience designing, building, and operating production ETL/ELT pipelines + Experience designing durable data models and schemas for complex, evolving datasets + Experience building high-throughput ingestion systems and optimizing data movement across storage, compute, and network boundaries + Experience with Docker and container orchestration platforms such as Kubernetes + Strong communication skills and experience working in cross-functional teams + Experience designing APIs or service interfaces used by multiple teams + Experience with scientific computing and large-scale neuroscience or other scientific data + Workflow orchestration experience with Airflow, Dagster, Prefect, or similar tools + Experience in building pipelines with and for autonomous, agentic AI systems + Experience with performance-critical compiled or systems languages (C, C++, or Rust) + Familiarity with data provenance and lineage tracking, metadata catalogs, or dataset versioning As part of your application, please submit the following two separate attachments : 1. Cover Letter - Please provide a cover letter describing your interest in joining our lab and the position. 2. Technical Experience Responses - In a separate document, please answer each of the questions below in a few sentences. Please upload your responses as a single, separate attachment to your application. 1. Please describe your experience working with SQL and NoSQL databases. 2. Please describe you experience operating ETL/ELT data pipelines. 3. Please describe your experience with orchestration tooling such as Kubernetes and Ray. You’ll Thrive in This Role If You: + Are excited by a fast-paced, production-focused research environment that often requires switching between many hats + Can move quickly without sacrificing rigor + Care about making complex workflows reliable and easy to use + Enjoy translating ambiguous research needs into pragmatic technical systems + Take ownership across design, implementation, deployment, and operations + Enjoy collaborative design and working closely across team boundaries + Are energized by working as part of a cohesive team pursuing ambitious, long-term neuroscientific and AI goals What We Offer: + A highly collaborative environment across neuroscience, engineering, and AI +

Benefits & conditions

Opportunity to contribute to a next-generation neurotechnology platform + Competitive salary and benefits + Strong mentoring and career development support, National average IT Jobs average California average

Salaries

The number of jobs in each salary range for all

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.com
Prepare application

Good distractions

Loading talks and stories from around this role…