Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+11 more
Job description
A Senior Data Engineer responsible for designing, developing, and supporting large-scale enterprise data solutions using Ab Initio and Snowflake. This role involves architecting high-volume ETL/ELT processes, data pipelines, and data warehouse solutions within cloud environments, primarily Azure. The individual will collaborate on cloud modernization efforts and optimize data workflows to support business intelligence and analytics initiatives., * Design and develop complex ETL workflows, data pipelines, and data integration solutions using Ab Initio and Snowflake.
- Build and support high-volume data processing frameworks and reusable components for enterprise-scale data flow management.
- Architect and implement data warehouse solutions, including schema design such as star and snowflake schemas, with a focus on performance and scalability.
- Optimize query performance, resource utilization, and cost management within Snowflake.
- Develop and maintain metadata management, lineage, impact analysis, and data quality validation processes.
- Collaborate on cloud modernization initiatives, supporting Azure-based data solutions.
- Manage data governance, security, and compliance using role-based access control and best practices.
- Automate operational processes, including data validation, file processing, and deployment workflows using scripting languages like Python and Shell.
- Provide operational support for existing data workflows, troubleshooting and resolving issues promptly.
- Participate in source-to-target mapping, data modeling, and MDM concepts to ensure data consistency and integrity across systems.
Requirements
- 6+ years of experience in Ab Initio development with expert-level knowledge of graph development, plans, plan execution, and parameter sets.
- Extensive hands-on experience with large and complex ETL workflows, high-volume data integration, and reusable framework development.
- Strong expertise in Snowflake architecture, SQL development, query optimization, and performance tuning.
- Proficiency with Snowflake features such as Snowpipe, streams, tasks, zero-copy cloning, and time travel.
- Experience in data modeling, dimensional design, and data warehouse architecture, including star and snowflake schemas.
- Skilled in Python and Shell scripting for automation and utility development.
- Knowledge of data quality validation, lineage management, and impact analysis tools such as Ab Initio Metadata Hub / EME.
- Familiarity with healthcare data systems, claims data, provider data, and population health analytics principles.
- Ability to work independently in a remote environment with strong problem-solving skills.
- Proven track record of delivering scalable data solutions in cloud-based environments, with familiarity in Azure preferred.
About the company
At GDH, we believe in the power of people and the importance of caring. Our culture statement, “We care about people,” isn’t just a tagline - it’s the core of everything we do. GDH is a premier staffing and talent solutions company dedicated to helping businesses find the best talent and assisting job seekers in finding their dream jobs.
Who We Are: GDH, founded in 2001, has grown into a leader in providing staffing solutions across various industries. We specialize in IT across several sectors, connecting top talent with leading enterprises. As a Best of Staffing firm recognized for excellence in client, employee, talent, and women’s services, we pride ourselves on our commitment to quality and service.
GDH Benefits
GDH offers a range of employee benefits that are designed to promote well-being and help maintain a healthy work-life balance. These comprehensive benefits cover various aspects of an employee’s life and aim to enhance their overall experience with the company. Our health benefits include three medical insurance options with access to KISx Card, Zero Card, and HealthJoy concierge services. Other plan offerings include dental, vision, life, disability, supplemental insurance, and pet insurance plans. Enjoy additional perks like holiday pay, 401(k) plan, direct deposit, an employee referral program, work-life balance benefits, a Wellbeats membership, a discounted gym membership program, and more! For more detailed information on benefits, please go to GDH’s website under the tab for candidates.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Engineer Salary UK
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
What Are The Top Skills Required For Azure Developers?
Top Big Data Technologies That You Need to Know