Software Engineer, Data Processing

Role: Software Engineer, Data Processing & Privacy. Location: Remote (PST). Start date: ASAP. Contract duration: 6+ months., Design and maintain data processing pipelines that transform raw datasets into structured, privacy-safe outputs for advanced research applications.

Day-to-Day Responsibilities

• Build and extend data processing pipelines for new data sources
• Ingest and normalize diverse data formats (JSON, NDJSON, HTML/XML, code, archives)
• Implement PII detection and de-identification processes
• Perform data quality QA using automated checks and assisted review tools
• Troubleshoot issues, iterate on feedback, and reprocess datasets
• Develop internal tools for auditing, monitoring, and data exploration
• Manage data storage, access controls, and delivery pipelines
• Document processes and improve pipeline efficiency over time

• 5+ years of software engineering experience with a focus on data pipelines
• Strong proficiency in Python
• Hands-on experience with PII handling, detection, and anonymization
• Experience working with large, messy, semi-structured datasets
• Familiarity with cloud storage and access control patterns (e.g., S3, GCS, IAM)
• Experience with data quality validation and monitoring
• Ability to work independently with strong attention to detail
• Experience using AI-assisted coding tools (e.g., Claude) with sound judgment

Nice-to-Haves

• Background in data privacy or legal/compliance environments
• Experience building internal data tools or self-serve platforms
• Exposure to information retrieval, search, or RAG systems
• Experience in high-scale or tech-forward organizations