> Markdown version of [/jobs/ext/2870938-principal-data-engineer](https://www.wearedevelopers.com/jobs/ext/2870938-principal-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Principal Data Engineer

- **Company:** Black Duck Software, Inc.
- **Location:** Cookstown, UK
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Data Security, Infrastructure as a Service (IaaS), Identity and Access Management, Python (Programming Language), Online Analytical Processing, Operational Databases, Standard Sql, Management of Software Versions, Google Cloud, Cloud Platform System, Delivery Pipeline, Low Latency, Operational Systems, Data Management, Machine Learning Operations, Stream Processing
- **Published:** September 13, 2026
- **Apply:** https://www.apply4u.co.uk/jobs/principal-data-engineer/47101685

## About the Role

hands-on in key systems.RequiredSignificant experience building and operating production data platforms at scale, including on-call and operational ownership.Strong SQL skills and strong Python skills, used to build pipelines, services, and automation.Hands-on experience running cloud systems on AWS and Google Cloud (IaaS level: compute, storage, networking, IAM).Practical experience with both operational databases (RDS-style) and analytics stores (columnar/OLAP), including performance tuning.Strong data modeling ability, including schema evolution, conformed dimensions, and "one source of truth" metric definitions.Track record of delivering data products that other teams or customers depend on, with clear contracts and reliability expectations.Ability to make sound engineering tradeoffs across latency, accuracy, cost, and security without creating brittle complexity.Experience with lakehouse patterns and open table formats (or similar), including governance and table maintenance.Experience
with orchestration and streaming systems used in production (batch + real-time), and managing backfills safely.Familiarity with ML data needs (training/serving splits, feature-ready datasets, evaluation datasets) and AI-adjacent workflows.PreferredExperience building self-service data platforms (catalog, discoverability, access controls) used by multiple teams.Experience in regulated or security-sensitive environments, including retention, auditing, and data access controls.Work model, location & travelLocation: Belfast, UKReports to: VP of Data EngineeringWork model: Hybrid (details TBD)Collaboration hours: Flexible; overlap with UK and US time zonesTravel: MinimalBlack Duck is an equal opportunity employer. We consider all applicants for employment without regard to race, color, national origin, religion, sex, gender identity or expression, age, disability, sexual orientation, veteran or military service status, or any other characteristic protected by applicable law. Black Duck
complies with all applicable laws prohibiting employment discrimination in every jurisdiction where it operates and provides reasonable accommodations to individuals with disabilities in accordance with applicable law. #J-18808-Ljbffr

## Description

data reliability: data contracts, quality checks, lineage, monitoring, and incident response.Implement and run access methods that make data usable: curated datasets, secure query interfaces, and product-ready data APIs where needed.Productize customer-facing data products (datasets, metrics, exports, and feeds) with versioning, documentation, and clear ownership.Design data models that fit both operational systems (RDS) and analytics stores (columnar/OLAP), including performance and cost tuning.Ensure data products also power ML workflows: trusted training datasets, feature-ready outputs, and consistent definitions for decision-making.Enable AI automation by delivering reliable, low-latency, governed data products that can be used safely in automated workflows.Partner closely with product, engineering, and security stakeholders to align data products to roadmap priorities and customer outcomes.Raise the technical bar through architecture reviews, standards, and mentoring-while staying