Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+19 more
Job description
The Data Engineer builds and scales enterprise data solutions within BCS’ ecosystem to support Enterprise Analytics, operational reporting, and self-service business intelligence.
This role focuses on developing governed, high-performance, and reusable data assets aligned with enterprise data architecture standards. The Data Engineer plays a key role in enabling advanced analytics, including data exploration, feature engineering, statistical modeling, and AI-driven use cases.
This position works in close coordination with the Enterprise Data Architect and broader IT teams to ensure consistency, scalability, security, and alignment with BCS’ long-term data strategy.
This role supports key enterprise initiatives including Data Enablement and AI-driven analytics.
This position will report to the Director of Data Engineering.
Essential Elements
List the duties and responsibilities the incumbent would be spending at least 15 - 20% of their time doing in this position.
- Design ETL pipelines using Microsoft Fabric and other enterprise data platforms asappropriate.
- Partner closely with the Enterprise Data Architect to align data models, pipelines, and storage patterns with enterprise data architecture standards
- Manage andoptimizedata within Microsoft FabricOneLake, including data residency andshortcuts.
- Develop andmaintaintransformation logic using Fabric Notebooks (PySpark/Spark SQL) across medallion architecture layers (bronze, silver, gold).
- Design and implementefficientincremental data loading and change data capture strategies.
- Partner with Analytics and business teams to deliver trusted, well-documented, and reusable datasets for reporting and advanced analytics
- Collaborate with analytics and data science teams to operationalize models and integrate outputs into business workflow
- Implement and enforce data governance standards, including data quality validation, lineage, classification, and access controls
- Support Enterprise Analytics’ use of AI techniques such as text extraction or natural language processing
- Ensure compliance with data privacy and regulatory requirements (e.g., PHI/PII handling)
- Prepare andmaintaindocumentation to ensure transparency, usability, and long-term maintainability
Requirements
Do you have experience in Version control?, Do you have a Bachelor’s degree?, Required - Bachelor of Science degree in Information Systems, Computer Science, Statistics, Data Science or other related field
Preferred - Relevant certifications in cloud, data engineering, or analytics platform
Experience
Required
- At least5years of experience in a data engineering role
- Advanced SQL skills for data transformation and modeling
- Hands on experience with Microsoft Fabric Data Factory for orchestration and ingestion
- Experience with medallion data architecture patterns
- Experience implementing data validation and pipeline monitoring
- Experience with ETL tools(e.gSSISor equivalent).
- Working knowledge of .NET/C#, Python, APIs, version control, CI/CDpracticesand agile workflow
Preferred
- Insurance industry experience
- Collaboration with data science teams
- Familiarity with Azure ecosystem (Azure SQL, Azure Functions, storage, etc.)
- Experience with data modeling techniques (e.g., dimensional modeling, star schema)
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Data Analyst Salary in the UK
Top Big Data Technologies That You Need to Know
The Most Popular IT Jobs on the Market