Data Engineer
Role details
Job location
Tech stack
Job description
QSSHire is seeking a Data Engineer to provide highly technical, hands-on data engineering support in a secure, mission-critical environment. This role is focused on designing and building data infrastructure, developing and maintaining data pipelines, and optimizing data systems. You will leverage modern cloud technologies and work with large-scale data environments to deliver reliable, high-quality data solutions.
In This Role, You'll: · Design, build, and maintain scalable data infrastructure and pipelines · Develop and optimize ETL/ELT workflows for reporting and analytics · Transform, cleanse, and prepare structured and unstructured data · Ensure data quality, integrity, and security across systems · Monitor, troubleshoot, and optimize data systems and pipelines · Integrate data from multiple sources across cloud and on-prem environments · Develop complex multi-data source queries across various database technologies · Build and maintain data pipelines using tools such as NiFi · Collaborate with stakeholders to gather requirements and deliver solutions · Document code, data pipelines, and engineering methodologies · Deliver technical findings through written documentation and oral briefings · Support system performance improvements and scalability efforts
Requirements
· Strong, recent experience in data engineering · Experience designing and building data infrastructure and pipelines · Experience developing scalable ETL/ELT workflows · Strong programming experience with Python · Experience working in AWS cloud environments · Strong experience with SQL · Experience constructing complex multi-data source queries using technologies such as PostgreSQL, MySQL, Neo4J, or RDS · Experience processing structured and unstructured data · Experience developing pipelines using Apache NiFi · Experience with Linux systems and advanced bash scripting · Experience using Git or similar version control tools · Experience with Elasticsearch and Kibana · Experience using Jupyter Notebooks · Experience working with multiple stakeholders · Strong documentation and communication skills · Experience developing reusable, testable, and reproducible code · Background in a technical field such as Computer Science, Data Science, Mathematics, Statistics, or similar, · Labor Category: Data Scientist (aligned to data engineering scope) · Demonstrated experience supporting data engineering and data-driven systems · Strong foundation in data engineering, data integration, and system design · Must have recent hands-on data engineering experience, · Experience with cloud services and data architectures (AWS preferred) · Experience with big data tools such as Apache Spark or Trino · Experience with containerization technologies (Docker, Kubernetes) · Experience with data visualization tools (Tableau, Kibana, Apache Superset) · Exposure to machine learning techniques, including NLP · Experience explaining complex technical concepts to junior team members · Experience creating technical training materials or curriculum, · Bachelor's degree in Computer Science, Data Science, Engineering, Mathematics, or a related field · Equivalent professional experience may be considered in lieu of a degree