Senior Data Engineer in United

Energy Jobline
Carbon, WV, United States
1 day ago
Apply on www.energyjobline.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Amazon Web Services Microsoft Azure Software as a Service Databases Information Engineering Data Infrastructure Extract Transform Load (ETL) Fault Tolerance Python (Programming Language) Key Management Microsoft SQL Server
+9 more
Power BI Data Logging Build Management Microsoft Fabric Data Management Hardware Infrastructure Data Pipelines Container Apps Key Vault

Job description

We’re looking for a Senior Data Engineer to design, build, and operate modern data platforms at scale. You’ll work across Azure, Microsoft Fabric, and AWS - building reliable pipelines, performant data models, and self-service analytics that drive real business decisions. A core part of this role is containerized workload execution: designing and deploying pipeline jobs using Azure Container Apps Jobs for scheduled and event-driven processing. This is a hands-on role for an engineer who thrives in ambiguity, values clean architecture, and moves comfortably between strategy and implementation., n \n

  • Develop Python-based ETL/ELT pipelines ingesting data from APIs, flat files, databases, and SaaS platforms \n

  • Build and deploy containerized jobs using Azure Container Apps Jobs, including scheduling, scaling rules, secrets management (Key Vault), and Container Registry integration \n

  • Maintain data movement between on-premises SQL Server and cloud targets \n

  • Design idempotent, fault-tolerant pipeline patterns with robust logging, alerting, and retry logic \n

  • Partner with analytics teams to deliver clean, well-documented data models for Power BI and similar BI tools \n

Requirements

  • 5-8 years of hands-on data engineering in production environments \n

  • Proven track record delivering data platforms on Azure and/or AWS \n

  • Experience migrating legacy on-premises infrastructure to cloud- solutions \n

  • Hands-on experience with Azure Container Apps Jobs or a comparable containerized job execution platform \n

Benefits & conditions

  • Design and build scalable data pipelines using Python and cloud- orchestration tools (Azure Data Factory, Azure Container Apps Jobs, Fabric Data Pipelines) \n

  • Architect solutions across Microsoft Fabric Warehouses, Azure SQL, and AWS (S3, Redshift), selecting the right tool for the workload \n

  • Implement Medallion/layered architecture (Bronze * Silver * Gold) for structured, governed data delivery \n

  • Manage and optimize large-scale data warehouse environments for performance, cost, and maintainability \n

\n

\n, n \n

  • Python - production-grade pipelines, transformations, and automation \n

  • SQL - advanced T-SQL and ANSI SQL; SQL Server, Azure SQL, Redshift, and Fabric query engines \n

  • Microsoft Fabric - Warehouses, Lakehouses, Data Pipelines, OneLake \n

  • Azure - ADF, Azure SQL, ADLS, Key Vault, Container Apps Jobs, Container Registry \n

  • Containerization - Docker image development, container registry management, Container Apps Jobs (scheduling, scaling, secret injection) \n

  • AWS - S3 for data lake storage, Redshift for cloud warehousing \n

  • Data Modeling - dimensional modeling, star/snowflake schema, ER modeling for OLTP and OLAP

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.energyjobline.com
Prepare application

Good distractions

Loading talks and stories from around this role…