Data Engineer

Quantum Science Solutions
McLean, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

McLean, United States of America

Tech stack

Amazon Web Services (AWS)
Apache HTTP Server
Bash
Big Data
Cloud Computing
Computer Programming
Databases
Data Architecture
Information Engineering
Data Infrastructure
Data Integration
ETL
Data Systems
Data Visualization
Linux
Elasticsearch
Revision Control Systems
Python
PostgreSQL
Machine Learning
MySQL
Neo4j
Cloud Services
Standard Sql
Tableau
Unstructured Data
Jupyter Notebook
Spark
GIT
Containerization
Kubernetes
Information Technology
Data Analytics
Apache Nifi
Data Management
Kibana
Data Pipelines
Docker

Job description

QSSHire is seeking a Data Engineer to provide highly technical, hands-on data engineering support in a secure, mission-critical environment. This role is focused on designing and building data infrastructure, developing and maintaining data pipelines, and optimizing data systems. You will leverage modern cloud technologies and work with large-scale data environments to deliver reliable, high-quality data solutions.


In This Role, You'll: · Design, build, and maintain scalable data infrastructure and pipelines · Develop and optimize ETL/ELT workflows for reporting and analytics · Transform, cleanse, and prepare structured and unstructured data · Ensure data quality, integrity, and security across systems · Monitor, troubleshoot, and optimize data systems and pipelines · Integrate data from multiple sources across cloud and on-prem environments · Develop complex multi-data source queries across various database technologies · Build and maintain data pipelines using tools such as NiFi · Collaborate with stakeholders to gather requirements and deliver solutions · Document code, data pipelines, and engineering methodologies · Deliver technical findings through written documentation and oral briefings · Support system performance improvements and scalability efforts

Requirements

· Strong, recent experience in data engineering · Experience designing and building data infrastructure and pipelines · Experience developing scalable ETL/ELT workflows · Strong programming experience with Python · Experience working in AWS cloud environments · Strong experience with SQL · Experience constructing complex multi-data source queries using technologies such as PostgreSQL, MySQL, Neo4J, or RDS · Experience processing structured and unstructured data · Experience developing pipelines using Apache NiFi · Experience with Linux systems and advanced bash scripting · Experience using Git or similar version control tools · Experience with Elasticsearch and Kibana · Experience using Jupyter Notebooks · Experience working with multiple stakeholders · Strong documentation and communication skills · Experience developing reusable, testable, and reproducible code · Background in a technical field such as Computer Science, Data Science, Mathematics, Statistics, or similar, · Labor Category: Data Scientist (aligned to data engineering scope) · Demonstrated experience supporting data engineering and data-driven systems · Strong foundation in data engineering, data integration, and system design · Must have recent hands-on data engineering experience, · Experience with cloud services and data architectures (AWS preferred) · Experience with big data tools such as Apache Spark or Trino · Experience with containerization technologies (Docker, Kubernetes) · Experience with data visualization tools (Tableau, Kibana, Apache Superset) · Exposure to machine learning techniques, including NLP · Experience explaining complex technical concepts to junior team members · Experience creating technical training materials or curriculum, · Bachelor's degree in Computer Science, Data Science, Engineering, Mathematics, or a related field · Equivalent professional experience may be considered in lieu of a degree

Apply for this position