Senior Data Engineer
Role details
Job location
Tech stack
Job description
We are hiring a Sr. Data Engineer to build the data infrastructure that powers our Enterprise Data Platform and integrated systems capabilities. You will work closely with our Enterprise Data Leader to Design and Implement ingestion pipelines, Medallion Tiers, construct Lakehouse/Relational/Warehouse data models, build data quality/lineage/access-control frameworks, and operationalize the analytical datasets that our data producing/consuming teams depend on.
This is a build-phase role. We have a newly deployed Azure/Databricks environment and need someone who can be productive immediately. You will be responsible for turning architectural designs into working, reliable, production-grade data pipelines within a tight timeline., Data Pipeline Development
- Build and maintain ingestion pipelines from source systems (OnCore, NetSuite, HubSpot, Microsoft Lists, Snowflake, FileMaker) into ADLS/Databricks
- Implement incremental load patterns, change data capture, and idempotent pipeline design to ensure reliability
- Design/Implement Metadata, Data Quality and Data Lineage capabilities
- Design/Implement AccessControl/RBAC capabilities
- Design/Implement DataRights/Licensing capabilities
- Develop the ETL/ELT processes that feed Lakehouse/Relational/Warehouse modeling requirements (matching, deduplication, golden record assembly) as designed by the MDM Lead
- Build publication pipelines that push canonical data models from the Data Platform back to spoke systems, coordinating with Integration Platform (Boomi based) and Messaging Platform (Azure Service Bus based) Teams
MDM Hub Implementation
- Implement Lakehouse/Relational/Warehouse tables for golden records across priority entities: Study/Protocol, Customer/Sponsor, Item/Charge Code, and Contract
- Build the matching and survivorship logic based on rules defined by data model requirements and validated by business stakeholders
- Implement versioning, lineage and audit trails using Delta Lake time travel capabilities for full traceability of master data changes
- Configure Unity Catalog for data governance, access controls, and lineage tracking
Data Quality and Monitoring
- Build automated data quality checks at ingestion, transformation, and publication stages
- Develop data quality dashboards and alerting (integrate with existing monitoring tools or build in Databricks SQL)
- Implement reconciliation count checks between source systems and the hub to detect drift or sync failures
- Create exception handling pipelines that surface records requiring manual review
Analytical and Reconciliation Datasets
- Build the data models supporting Revenue Cycle (e.g. OnCore-to-NetSuite) reconciliation (matching clinical events to financial transactions)
- Develop the unbilled-vs-billed tracking datasets that compare recognized sales order lines against invoiced amounts
- Create revenue accrual support datasets that feed the finance team's automated journal entry processes in NetSuite
- Support pass-through item mapping and amendment pricing reconciliation data needs as the finance team defines requirements
Platform Operations
- Establish CI/CD patterns for Databricks notebooks and jobs (Repos integration, testing frameworks)
- Configure and manage job scheduling, cluster policies, and cost optimization
- Maintain dev/staging/production environment separation
- Document all pipelines, data models, and operational procedures, * Occasional travel (0-5% annually) may be required for team meetings, company events, or client engagements, though most collaboration will occur virtually via video conferencing and online tools.
Requirements
- 4+ years of experience as a data engineer, with at least 2 years on Azure Databricks or equivalent Spark-based platforms
- Strong/Current proficiency in Azure Data Factory, ADLS Gen2, Databricks, Delta Lake, Databricks SQL, Azure SQL
- Strong/Current proficiency in Python, SQL, PySpark, and Spark SQL
- Experience with Data Lakes, Lake Houses and Warehouses
- Experience building production data pipelines with proper error handling, retry logic, idempotency, and monitoring
- Familiarity Azure and Azure ecosystem services
- Experience with Unity Catalog, Purview or equivalent data governance/catalog tooling
- Experience with Data Governance guidelines such as Data Classification, Retention, De-Identification, Tenancy, Sovereignty and Data Standards
- Experience with CI/CD for data engineering workloads (Databricks Repos, Azure DevOps, or similar)
Preferred Education and Experience:
- Experience with MDM data pipelines (matching, deduplication, golden record logic)
- Familiarity with ERP data models (NetSuite preferred) or clinical trial management systems (OnCore)
- Experience with Snowflake (existing analytical layer we are integrating with)
- Experience with Boomi or other iPaaS tools from a data engineering perspective
- Background in healthcare, life sciences, or clinical research data
- Experience building financial reconciliation or revenue recognition datasets
Benefits & conditions
Referral program, Professional development assistance, Parental leave, 401(k), Health insurance, 401(k) matching, Paid time off, Vision insurance Full-time Monday to Friday Remote, The annual base salary for this role is $130,000- $145,000. However, base pay may vary depending on multiple individualized factors including market location, job-related knowledge, skills, and experience.
Work Schedule: Monday-Friday 8:00am-5:00pm, We value the time, talent, and dedication our employees bring to START. Our commitment to your well-being and growth is reflected in a competitive compensation package-based on experience-along with comprehensive benefits designed to support you both personally and professionally:
- 401(k) retirement savings plan with employer match
- Eligibility for an annual performance bonus, based on role and company results
- Generous paid time off and paid holidays
- Comprehensive medical, dental, and vision coverage and optional insurance options
- Company p-aid life and disability insurance for added financial protection
- Employee Assistance Program (EAP) providing confidential, no -cost support for you and your family from day one
- Flexible FSA and HSA plans to support your financial wellness
- Commitment to a supportive environment that values balance, wellbeing, and flexibility
- We're committed to fostering a collaborative, creative workplace where every team member is encouraged to contribute. At START, you'll join a team that values continuous learning, professional growth, shared ideas, and a culture built on inclusivity and innovation.
More About START
START clinical trial sites have conducted more than 1,000 early-phase clinical trials, including dozens of therapies that were approved by the FDA or EMA. START represents the world's largest roster of early-phase principal investigators across its Network of clinical trial sites. Committed to accelerating passage from trials to treatments, START delivers hope to patients, families, and physicians around the world via our mission of "Hope Through Access". As an example, in San Antonio, where START was founded, START treated the first patient ever with Keytruda - one of the most effective cancer drugs in medical history.
Learn more at STARTresearch.com.
Ready to be part of a team changing the future of cancer treatment?
Join us in our mission to conquer cancer, one clinical trial at a time. Your expertise and dedication can help us bring hope and healing to patients worldwide. Please submit your application online.
We are an equal opportunity employer that welcomes and encourages diversity in the workplace. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, veteran status, or any other status protected under federal, state, or local law.
Pay: $130,000.00 - $145,000.00 per year, * 401(k)
- 401(k) matching
- Dental insurance
- Employee assistance program
- Health insurance
- Health savings account
- Life insurance
- Paid time off
- Parental leave
- Professional development assistance
- Referral program
- Vision insurance