Data Engineer Senior
Role details
Job location
Tech stack
Job description
Design, develop, and maintain robust ETL pipelines for data ingestion and transformation. * Implement data quality assurance (QA) and validation processes throughout the ETL lifecycle. * Ensure accurate data movement from shared file transfer services to Amazon S3 and Snowflake. * Monitor, troubleshoot, and optimize data pipelines to maintain reliable data flow. * Identify and resolve data quality issues, including source data inconsistencies that may cause ingestion failures or data rollbacks. * Collaborate with business owners, data analysts, BI teams, and other stakeholders to understand business requirements and deliver high-quality data solutions. * Translate business requirements into scalable technical solutions. * Follow secure coding practices and cybersecurity standards related to data engineering and DevOps. * Support Agile development processes and participate in planning, development, and deployment activities.
Requirements
We seeking a Senior Data Engineer with strong experience in data engineering, ETL development, and data quality assurance. The primary responsibility is to ensure the integrity, accuracy, and reliability of data as it moves from a shared file transfer service to Amazon S3, through Snowflake, and into downstream applications and reporting systems. The ideal candidate will have expertise in Python, SQL, cloud technologies, ETL pipelines, and data quality management, along with strong analytical and collaboration skills., 5+ years of experience in Data Engineering with a strong focus on: + Data Quality Assurance + Data Validation + ETL Development * 5+ years of experience with: + Python + PyPI, Data access and governance * Strong analytical and problem-solving skills. * Ability to gather business requirements and translate them into technical solutions. * Excellent communication and stakeholder collaboration skills. * Experience working in Agile environments.
Preferred Technical Skills * Snowflake * Amazon S3 * Python * SQL * PyPI * ETL Development * Data Quality / Data Validation * Data Integration * Public Cloud * DevOps * Cybersecurity Fundamentals * Agile Methodology, Data Engineering (ETL & Data Quality)