> Markdown version of [/jobs/ext/3110316-principal-data-engineer](https://www.wearedevelopers.com/jobs/ext/3110316-principal-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Principal Data Engineer

- **Company:** OCTAVE LLC
- **Location:** Houston, TX, United States (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Airflow, Data Architecture, Data Validation, Data Deduplication, Information Engineering, Data Integration, Extract Transform Load (ETL), Data Mining, Graph Database, Python (Programming Language), Microsoft SQL Server, OAuth, Octave, Open Data Protocol, Oracle (Applications), Openapi, Enterprise Software Applications, Data Classification, Azure Data Factory, Apache Spark, Change Data Capture, Microsoft Fabric, Data Lakes, Pyspark, Debezium, Data Lineage, Database Mirroring, Restful APIs, Azure Synapse Analytics, Data Pipelines
- **Published:** September 27, 2026
- **Apply:** https://www.dice.com/job-detail/034900e3-eae6-433c-b2c5-f63b37f97c20

## About the Role

* 7+ years in data engineering, with hands-on production experience building and operating ETL/ELT pipelines at scale
 * Strong proficiency with Microsoft Fabric or Azure Synapse Analytics - Delta Lake, lakehouse architecture, and Spark-based transformation
 * Experience with database mirroring or CDC for SQL Server (e.g. Fabric Database Mirroring, Debezium, SQL Server replication) and Oracle
 * Hands-on experience with REST API integration and OData/OpenAPI-based data extraction
 * Solid understanding of medallion/lakehouse architecture patterns (Bronze/Silver/Gold or equivalent staging discipline)
 * Experience with pipeline orchestration tools (Azure Data Factory, Fabric Data Workflows, Airflow, or comparable)
 * Proficiency in Python and/or PySpark for transformation logic and notebook-based ETL
 * Strong data quality mindset - schema validation, null handling, deduplication, and monitoring at ingestion
 * Familiarity with enterprise authentication patterns (OAuth2 client credentials, service principals, managed identities)

Preferred:

 * Experience with Databridge Pro or comparable industrial middleware integration products
 * Background in capital projects, EPC, or industrial enterprise software data models
 * Exposure to knowledge graph construction pipelines downstream of lakehouse staging

## Description

The Data Engineer owns the reliable flow of data from Hexagon's source products into the Octave platform's Microsoft Fabric lakehouse. This role is responsible for building and operating the connectors, pipelines, and staging infrastructure that ensure every downstream capability - from ontological transformation to knowledge graph construction - has high-quality, timely, and trustworthy data to work with. The Data Engineer is the first and most critical link in the platform's data supply chain.

 * Design, build, and operate data integration pipelines connecting Hexagon source products (Sequence/EcoSys, Loop/Smart Materials, Forte 3D, Attune/EAM) to the Fabric lakehouse
 * Implement and maintain database mirroring configurations for SQL Server and Oracle source systems, ensuring near-real-time replication with schema change detection
 * Configure and operate Databridge Pro (DBPro) as a middleware integration layer where direct mirroring is not viable - API adapters, event streams, and scheduled extracts
 * Enforce the staging discipline: land data in its original form in the lakehouse Bronze layer before any transformation, minimizing logic in extractors and enabling replay
 * Build and maintain the change-data-capture (CDC) infrastructure to track record-level changes over time - a prerequisite for temporal queries and the Delivery Genome
 * Own pipeline observability: monitoring, alerting, lineage tracking, and data quality checks at ingestion time
 * Collaborate with the Graph Engineer on schema understanding to ensure ingested data maps cleanly to ontological transformation requirements
 * Work with the Governance function to implement data classification, access controls, and audit-ready lineage at the pipeline level
 * Contribute to the no-code pipeline capability within Platform Studio's data engineering tool, informing what connectors and patterns should be productized


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Perfect Pitch: Unveiling the Mathematical Symphony Behind a Guitar Tuner](https://www.wearedevelopers.com/videos/1095-perfect-pitch-unveiling-the-mathematical-symphony-behind-a-guitar-tuner)
- [Keeping applications secure by evolving OAuth 2.0 and OpenID Connect](https://www.wearedevelopers.com/videos/100152-keeping-applications-secure-by-evolving-oauth-2-0-and-openid-connect)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment)
- [Delay the AI Overlords: How OAuth and OpenFGA Can Keep Your AI Agents from Going Rogue](https://www.wearedevelopers.com/videos/1637-delay-the-ai-overlords-how-oauth-and-openfga-can-keep-your-ai-agents-from-going-rogue)

## Related Articles

- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)