> Markdown version of [/jobs/ext/4009602-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/4009602-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** Spark Tek Inc
- **Location:** San Jose, CA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Airflow, Amazon Web Services, Microsoft Azure, Big Data, Continuous Integration, Data Validation, Information Engineering, Data Governance, Data Infrastructure, Data Integrity, Extract Transform Load (ETL), Data Loss, Data Mapping, Data Structures, Document-Oriented Databases, Python (Programming Language), PostgreSQL, NoSQL, Oracle (Applications), Query Optimization, Data Logging, Great Expectations (Foster Youth College-readiness and Support Program), Software Troubleshooting, Indexer, Git, Database Migration, Data Lineage, Data Pipelines, Docker
- **Published:** October 29, 2026
- **Apply:** https://www.thejobnetwork.com/job/df4a8ed7-4539-4841-a817-aecd95f1b8d9/senior-data-engineer

## About the Role

* 7 years of experience in Data Engineering.
 * Strong to expert-level Python skills.
 * Deep hands-on experience with PostgreSQL and/or Oracle.
 * Proven experience designing and managing ETL/ELT pipelines at scale.
 * Experience with large-scale data migration projects involving millions of records.
 * Strong experience with data mapping, transformation, validation, and reconciliation.
 * Knowledge of data modeling, normalization, indexing, and partitioning.
 * Experience with Git and CI/CD practices.
 * Strong troubleshooting and problem-solving skills., * Experience with Airflow, Dagster, or Prefect.
 * Experience with AWS, GCP, or Azure.
 * Exposure to NoSQL and cross-database migrations.
 * Experience working in regulated or high-stakes data environments.
 * Experience with Docker and Infrastructure-as-Code.
 * Familiarity with Great Expectations, dbt tests, or similar data quality frameworks.

## Description

* Lead end-to-end migration, transformation, and loading of high-volume, complex data into PostgreSQL.
 * Design, build, and maintain scalable ETL/ELT pipelines processing millions of records.
 * Map and reconcile complex legacy data structures across multiple business entities.
 * Develop data validation and reconciliation frameworks to ensure data integrity and completeness.
 * Optimize PostgreSQL performance through query tuning, indexing, partitioning, and batch/incremental loading.
 * Troubleshoot data quality issues, schema mismatches, and pipeline failures.
 * Document data mappings, transformation logic, data lineage, and migration runbooks.
 * Collaborate with business and technical stakeholders on migration requirements and timelines.
 * Establish monitoring, logging, and alerting for pipeline health and data quality.
 * Mentor junior data engineers and contribute to engineering best practices., * Fully migrated and validated datasets in PostgreSQL with zero critical data loss or corruption.
 * Documented, repeatable, and optimized ETL/ELT pipelines.
 * Clear data lineage and audit trails for migration and validation activities.

https://job.goodword.io/JobLanding/JobId=df4a8ed7-4539-4841-a817-aecd95f1b8d9?trafficsourceid=0
external