Data Movement Engineer (Snowflake + Talend) - No C2C

Purplejack Technologies Llc
New Haven, CT, United States
6 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Airflow Data Analysis JIRA Cloud Database Code Review Databases Continuous Integration Data Architecture Data Governance Data Integrity Extract Transform Load (ETL) Data Vault Modeling
+20 more
Data Warehousing IBM DB2 Dimensional Modeling Python (Programming Language) Meta-Data Management Microsoft SQL Server Oracle (Applications) DataOps SQL Databases Talend Workflow Management Systems Scripting Data Ingestion Snowflake Change Data Capture Git Low Latency Software Version Control Data Pipelines Servicenow

Job description

Manage the full lifecycle of Snowflake data operations, including monitoring, troubleshooting, and optimizing data pipelines.

Proactively identify and resolve issues related to data integrity, latency, and pipeline failures to maintain smooth operations.

Translate stakeholder requirements into Snowflake-specific solutions for data movement.

Develop and optimize SQL queries, warehouse configurations, and data models for performance, reliability, and scalability.

Design, develop, and optimize Snowflake data pipelines and models.

Recommend and implement best practices for data ingestion, transformation, storage, security and data modeling.

Support advanced features like Change Data Capture (CDC) and Slowly Changing Dimensions (SCD Type 2).

Support frameworks like Data Vault and dimensional modeling in Snowflake.

Monitor and troubleshoot data pipeline failures and performance issues in ETL and Snowflake environments.

Thoroughly test all production solutions prior to implementation.

Perform root cause analysis of data discrepancies, latency, and integrity issues.

Provide production support for IBM DB2, Snowflake, and orchestration tools (Airflow, ESP).

Collaborate with other teams to implement fixes and preventive measures.

Perform data quality analysis, report issues, and propose solutions.

Ensure data accuracy, completeness, and consistency across systems.

Implement validation and reconciliation checks within pipelines.

Support data governance initiatives including metadata management and lineage tracking.

Lead the design, development, and maintenance of Snowflake processes.

Provide technical leadership, code reviews, and mentorship to junior developers.

Coordinate with business stakeholders, data architects, and application teams to gather requirements and deliver solutions.

Communicate issue status, impact, and resolution timelines effectively.

Maintain comprehensive documentation for all Snowflake-related issues, fixes, and scripts, ensuring they are version-controlled and aligned with data architecture and security standards.

Develop and maintain production support playbooks and detailed ticket resolution procedures to enable consistent and efficient incident handling.

Prepare effort estimations and contribute to architectural decisions.

Provide regular updates and reports on issue trends and improvement initiatives.

Requirements

Minimum of 5 years of relevant experience in data warehousing, business intelligence tools, and data analysis.

Minimum of 3 years of SQL query development across multiple database platforms (Snowflake, Oracle, SQL Server, DB2).

Strong expertise in Snowflake (development, data modeling, security). Snowflake certification preferred.

Strong proficiency in SQL and scripting languages (e.g., Python, Shell).

Experience with cloud database technologies.

Familiarity with orchestration tools (ESP, Airflow) and version control systems (Git).

Experience with incident management tools (e.g., ServiceNow, Jira) and CI/CD practices.

Expertise in CDC and SCD Type 2 implementations using SQL.

Solid understanding of data architecture, dimensional modeling, and frameworks like Data Vault.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…