Data Engineer (Software Developer 2)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+8 more
Requirements
performance across the data stack, and lead troubleshooting/incident response when things break + Build tools with and to help researchers and our in-house AI agents discover datasets, inspect processing state, and safely diagnose or rerun failed jobs + Productionize research code - testing, packaging, deployment, monitoring, documentation + Partner with data acquisition, infrastructure engineering, scientific analysis and AI modeling teams. Preferred Qualifications: + Strong proficiency in Python and SQL + Experience with relational and NoSQL databases, as well as object storage (e.g., S3, MinIO, Ceph) + Experience designing, building, and operating production ETL/ELT pipelines + Experience designing durable data models and schemas for complex, evolving datasets + Experience building high-throughput ingestion systems and optimizing data movement across storage, compute, and network boundaries + Experience with Docker and container orchestration platforms such as Kubernetes + Strong communication skills and experience working in cross-functional teams + Experience designing APIs or service interfaces used by multiple teams + Experience with scientific computing and large-scale neuroscience or other scientific data + Workflow orchestration experience with Airflow, Dagster, Prefect, or similar tools + Experience in building pipelines with and for autonomous, agentic AI systems + Experience with performance-critical compiled or systems languages (C, C++, or Rust) + Familiarity with data provenance and lineage tracking, metadata catalogs, or dataset versioning As part of your application, please submit the following two separate attachments : 1. Cover Letter - Please provide a cover letter describing your interest in joining our lab and the position. 2. Technical Experience Responses - In a separate document, please answer each of the questions below in a few sentences. Please upload your responses as a single, separate attachment to your application. 1. Please describe your experience working with SQL and NoSQL databases. 2. Please describe you experience operating ETL/ELT data pipelines. 3. Please describe your experience with orchestration tooling such as Kubernetes and Ray. You’ll Thrive in This Role If You: + Are excited by a fast-paced, production-focused research environment that often requires switching between many hats + Can move quickly without sacrificing rigor + Care about making complex workflows reliable and easy to use + Enjoy translating ambiguous research needs into pragmatic technical systems + Take ownership across design, implementation, deployment, and operations + Enjoy collaborative design and working closely across team boundaries + Are energized by working as part of a cohesive team pursuing ambitious, long-term neuroscientific and AI goals What We Offer: + A highly collaborative environment across neuroscience, engineering, and AI +
Benefits & conditions
Opportunity to contribute to a next-generation neurotechnology platform + Competitive salary and benefits + Strong mentoring and career development support, National average IT Jobs average California average
Salaries
The number of jobs in each salary range for all
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…