Data Engineer

BCS LLC
Oakbrook Terrace, IL, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$111,000.0 - $140,000.0
Working hours
Regular working hours
Job source

Tech stack

.NET Framework Application Programming Interfaces (APIs) Artificial Intelligence Data Analysis Microsoft Azure C Sharp (Programming Language) Cloud Computing Information Systems Data Architecture Data Validation Information Engineering Data Governance
+19 more
Extract Transform Load (ETL) Data Transformation Dimensional Modeling Apache Hive Python (Programming Language) SQL Azure Natural Language Processing Enterprise Data Management Feature Engineering Sql Optimization Change Data Capture Data Strategy Microsoft Fabric Pyspark Information Technology Star Schema Data Management Software Version Control Serverless Computing

Job description

The Data Engineer builds and scales enterprise data solutions within BCS’ ecosystem to support Enterprise Analytics, operational reporting, and self-service business intelligence.

This role focuses on developing governed, high-performance, and reusable data assets aligned with enterprise data architecture standards. The Data Engineer plays a key role in enabling advanced analytics, including data exploration, feature engineering, statistical modeling, and AI-driven use cases.

This position works in close coordination with the Enterprise Data Architect and broader IT teams to ensure consistency, scalability, security, and alignment with BCS’ long-term data strategy.

This role supports key enterprise initiatives including Data Enablement and AI-driven analytics.

This position will report to the Director of Data Engineering.

Essential Elements

List the duties and responsibilities the incumbent would be spending at least 15 - 20% of their time doing in this position.

  • Design ETL pipelines using Microsoft Fabric and other enterprise data platforms asappropriate.
  • Partner closely with the Enterprise Data Architect to align data models, pipelines, and storage patterns with enterprise data architecture standards
  • Manage andoptimizedata within Microsoft FabricOneLake, including data residency andshortcuts.
  • Develop andmaintaintransformation logic using Fabric Notebooks (PySpark/Spark SQL) across medallion architecture layers (bronze, silver, gold).
  • Design and implementefficientincremental data loading and change data capture strategies.
  • Partner with Analytics and business teams to deliver trusted, well-documented, and reusable datasets for reporting and advanced analytics
  • Collaborate with analytics and data science teams to operationalize models and integrate outputs into business workflow
  • Implement and enforce data governance standards, including data quality validation, lineage, classification, and access controls
  • Support Enterprise Analytics’ use of AI techniques such as text extraction or natural language processing
  • Ensure compliance with data privacy and regulatory requirements (e.g., PHI/PII handling)
  • Prepare andmaintaindocumentation to ensure transparency, usability, and long-term maintainability

Requirements

Do you have experience in Version control?, Do you have a Bachelor’s degree?, Required - Bachelor of Science degree in Information Systems, Computer Science, Statistics, Data Science or other related field

Preferred - Relevant certifications in cloud, data engineering, or analytics platform

Experience

Required

  • At least5years of experience in a data engineering role
  • Advanced SQL skills for data transformation and modeling
  • Hands on experience with Microsoft Fabric Data Factory for orchestration and ingestion
  • Experience with medallion data architecture patterns
  • Experience implementing data validation and pipeline monitoring
  • Experience with ETL tools(e.gSSISor equivalent).
  • Working knowledge of .NET/C#, Python, APIs, version control, CI/CDpracticesand agile workflow

Preferred

  • Insurance industry experience
  • Collaboration with data science teams
  • Familiarity with Azure ecosystem (Azure SQL, Azure Functions, storage, etc.)
  • Experience with data modeling techniques (e.g., dimensional modeling, star schema)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:11 min

Evaluating application design patterns in microservices

Paweł Siwek Paweł Siwek · WWC 2025

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

1:53 min

Selecting appropriate container orchestration and data storage

Paweł Siwek Paweł Siwek · WWC 2025

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all