Data Engineer Senior

BURGEON IT SERVICES LLC
Raleigh, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Raleigh, United States of America

Tech stack

Agile Methodologies
Amazon Web Services (AWS)
Cloud Computing
Computer Security
Data Auditing
Data Validation
Information Engineering
Data Integration
ETL
Data Security
Data Systems
DevOps
File Transfer
Python
Standard Sql
Secure Coding
SQL Databases
Data Streaming
Data Ingestion
Snowflake
Data Pipelines

Job description

Design, develop, and maintain robust ETL pipelines for data ingestion and transformation. * Implement data quality assurance (QA) and validation processes throughout the ETL lifecycle. * Ensure accurate data movement from shared file transfer services to Amazon S3 and Snowflake. * Monitor, troubleshoot, and optimize data pipelines to maintain reliable data flow. * Identify and resolve data quality issues, including source data inconsistencies that may cause ingestion failures or data rollbacks. * Collaborate with business owners, data analysts, BI teams, and other stakeholders to understand business requirements and deliver high-quality data solutions. * Translate business requirements into scalable technical solutions. * Follow secure coding practices and cybersecurity standards related to data engineering and DevOps. * Support Agile development processes and participate in planning, development, and deployment activities.

Requirements

We seeking a Senior Data Engineer with strong experience in data engineering, ETL development, and data quality assurance. The primary responsibility is to ensure the integrity, accuracy, and reliability of data as it moves from a shared file transfer service to Amazon S3, through Snowflake, and into downstream applications and reporting systems. The ideal candidate will have expertise in Python, SQL, cloud technologies, ETL pipelines, and data quality management, along with strong analytical and collaboration skills., 5+ years of experience in Data Engineering with a strong focus on: + Data Quality Assurance + Data Validation + ETL Development * 5+ years of experience with: + Python + PyPI, Data access and governance * Strong analytical and problem-solving skills. * Ability to gather business requirements and translate them into technical solutions. * Excellent communication and stakeholder collaboration skills. * Experience working in Agile environments.

Preferred Technical Skills * Snowflake * Amazon S3 * Python * SQL * PyPI * ETL Development * Data Quality / Data Validation * Data Integration * Public Cloud * DevOps * Cybersecurity Fundamentals * Agile Methodology, Data Engineering (ETL & Data Quality)

Apply for this position