Senior Data Engineer

ECS Corporate Services, LLC

Fairfax, VA, United States

about 1 month ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Compensation

$165,000.0 - $180,000.0

Working hours

Regular working hours

Job source

www.disabledperson.com

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Artificial Intelligence Microsoft Azure Data as a Services Data Validation Information Engineering Extract Transform Load (ETL) Data Systems Relational Databases Database Queries Fault Tolerance

+22 more

Interoperability Python (Programming Language) Machine Learning Microsoft Software SQL Azure NumPy Performance Tuning Cloud Services Tensorflow Azure Machine Learning Azure Data Lake Systems Integration Workflow Management Systems Enterprise Data Management Data Logging Azure Data Factory Pytorch Pandas Microsoft Fabric Scikit Learn Api Design Microservices

Job description

Lead development of production-grade ETL workflows using Python and Microsoft-based technologies.
Design and optimize scalable ingestion, transformation, and validation pipelines for structured and unstructured datasets.
Implement schema enforcement, data validation, anomaly detection, and quality assurance frameworks.
Architect and manage Azure-based data solutions including Azure Data Lake Storage and Azure SQL.
Design and deploy orchestration workflows using Azure Data Factory and Microsoft Fabric/Foundry.
Develop Python-based data services leveraging libraries such as Pandas, PyTorch, TensorFlow, and related open-source frameworks.
Build APIs and microservices supporting interoperability with analytics and AI/ML platforms.
Implement monitoring, logging, fault tolerance, and performance optimization for large-scale systems.
Collaborate closely with data scientists, analysts, architects, and governance teams to deliver secure, reliable, and analytics-ready datasets.
Support Agile development processes and contribute to continuous improvement initiatives.

Salary Range: $165,000-$180,000

Requirements

5+ years of experience developing and deploying advanced statistical, machine learning, or enterprise data pipeline solutions.
Strong proficiency in Python, including Pandas and related data engineering libraries.
Strong SQL skills and experience integrating relational database systems.
Hands-on experience designing and operating solutions in Azure cloud environments.
Experience developing ETL workflows using Python and Microsoft technologies.
Experience with schema enforcement, data validation, and quality assurance practices.
Experience developing APIs and cloud-native data services.
Familiarity with workflow orchestration tools such as Azure Data Factory.
Experience with performance optimization, logging, and monitoring for enterprise-scale systems.
Familiarity with open-source data processing and ML frameworks such as PyTorch, TensorFlow, NumPy, and scikit-learn.