> Markdown version of [/jobs/ext/3850865-principal-data-engineer](https://www.wearedevelopers.com/jobs/ext/3850865-principal-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Principal Data Engineer

- **Company:** The Walt Disney Company
- **Location:** San Francisco, CA, United States
- **Experience:** Expert
- **Salary:** $187,900.0 - $252,000.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Airflow, Amazon Web Services, Amazon S3, Big Data, BigQuery, Cloud Computing, Cloud Database, Software Quality, Information Systems, Continuous Integration, Data Governance, Data Integration, Data Warehousing, Distributed Systems, Apache Hadoop, Apache Hive, Identity and Access Management, Python (Programming Language), Marketing Information Systems, Performance Tuning, Real Time Systems, Snowflake, Apache Spark, Information Technology, Real Time Data, Presto, Functional Programming, Terraform, Amazon Redshift, Databricks
- **Published:** October 21, 2026
- **Apply:** https://dejobs.org/x/x/6EB6620843934FCA97615BA7F3B8F461/job/

## About the Role

* 10+ years of related big data engineering experience modeling and developing large data pipelines and experience with Python, Scala, or Java; strong AWS fundamentals (S3, Lambda, IAM) preferred.
 * 5+ years hands-on experience including performance tuning at scale with distributed systems such as Hadoop or Databricks compute using tools/libraries such as Spark, Presto, Hive to query and process large datasets at the petabyte level.
 * Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query, Databricks)
 * Solid understanding of Data Modeling techniques and Data Warehousing standard methodologies and practices
 * Operational experience in multi-system/services production environment as senior data engineer and point-of-contact / SME
 * Problem solving skills with strong attention to detail and excellent analytical and communication skills
 * Solid experience with data integration and orchestration toolsets (e.g. Airflow), CI/CD
 * Demonstrated ability with cloud infrastructure technologies, including Terraform.
 * Strong understanding of slowly changing dimensions (SCD tables) and how to build scalable and performant datasets.

Required Education

 * Bachelor's degree in computer science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience

## Description

As Principal Data Engineer for Marketing and Consumer Data, you will serve as the senior technical leader for Identity and Device data products - including Identity360 and related consumer identifier datasets - that underpin marketing measurement, activation, and analytics across Disney Entertainment & ESPN. You will define technical direction, drive complex cross-system initiatives, establish engineering standards, and mentor leads and senior engineers, while partnering with onshore squad leaders, product, and enterprise architecture to deliver reliable batch and near-real-time data at petabyte scale., * Define and drive technical strategy for Identity & Device data products within Marketing and Consumer Data - including pipeline architecture, platform patterns, and modernization roadmap in partnership with onshore squad leaders and enterprise architecture.

 * Lead end-to-end delivery of complex, high-impact initiatives across Identity360, device/consumer identifier datasets, and dependent Marketing data products - setting technical approach, sequencing, and quality bar for other engineers.
 * Serve as principal SME and escalation point for identity foundational data - data modeling, batch and near-real-time processing, performance at scale, and production reliability - including participation in on-call rotation and incident leadership for critical pipelines.
 * Establish and uphold engineering standards for the Identity & Device team and Marketing Data Engineering - code quality, CI/CD, observability, data governance (GDPR, RTBF, CCPA), and reusable platform patterns across Databricks, AWS, and orchestration tooling.
 * Mentor and develop engineers through design reviews, pairing, and coaching - building depth in big-data engineering, identity domain knowledge, and operational excellence.
 * Partner cross-functionally with Product, QA, Operations, Privacy/Legal, and peer Marketing data squads (Data Collection, Activation, Acquisition) to align requirements, resolve cross-domain dependencies, and represent Bangalore technical decisions to stakeholders.