Staff Software Engineer, Big Data, tvScientific

Tvscientific, Inc.
San Francisco, CA, United States
4 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$177,185.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Big Data Software Documentation Data Validation Information Engineering Data Files Data Governance Data Infrastructure Meta-Data Management Operational Databases Software Engineering
+6 more
Delivery Pipeline Apache Spark Data Lakes Information Technology Data Lineage Data Pipelines

Job description

We are seeking a Staff Data Engineer to lead the design, implementation, and evolution of our identity services and data governance platform. This role is critical to ensuring trusted, privacy-safe, and well-governed data across the organization. You will work at the intersection of data engineering, identity resolution, privacy, and platform reliability. This is an individual contributor role, where you will work to define and implement a strategic vision for data engineering within the organization.

What you’ll do:

  • Design and maintain a scalable identity resolution platform
  • Build pipelines and services to ingest, normalize, link, and version identity data across multiple sources
  • Ensure deterministic and probabilistic matching logic that is transparent, auditable, and measurable
  • Partner with product and analytics teams to expose identity data through reliable, well-documented APIs and datasets
  • Build and operate batch and streaming pipelines using modern data stack tools
  • Create clear documentation, standards, and runbooks for identity and governance systems
  • Own data governance foundations including data lineage, quality checks, schema enforcement, and access controls
  • Implement privacy-by-design principles (PII handling, consent enforcement, retention policies)
  • Collaborate with legal, privacy, and security teams to operationalize regulatory requirements (e.g., GDPR, CCPA)
  • Establish monitoring and alerting for data quality, freshness, and integrity

Requirements

Software Engineering, Big Data, Media Buying and Planning, Digital Media, Advertising, Television Advertising, Business Growth, Application Programming Interface (API), Data Sets, Documentation Standards, * Production data engineering experience

  • Bachelor’s degree in computer science, related field or equivalent experience
  • Proficiency in Spark and Scala, with proven experience building data infrastructure in Spark using Scala
  • Experience in delivering significant technical initiatives and building reliable, large scale services
  • Experience in delivering APIs backed by relationship-heavy datasets
  • Experience implementing data governance practices, including data quality, metadata management, and access controls
  • Strong understanding of privacy-by-design principles and handling of sensitive or regulated data
  • Familiarity with data lakes, cloud warehouses, and storage formats
  • Strong proficiency in AWS services
  • Excellent written and verbal communication skills
  • Successful design and implementation of scalable and efficient data infrastructure
  • High attention to detail in implementation of automated data quality checks
  • Effective collaboration with cross-functional teams
  • Demonstrated ability to use AI to improve speed and quality in your day-to-day workflow for relevant outputs
  • Strong track record of critical evaluation and verification of AI-assisted work (e.g., testing, source-checking, data validation, peer review)
  • High integrity and ownership: you protect sensitive data, avoid over-reliance on AI, and remain accountable for final decisions and deliverables

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…