ETL Developer

Spruce Technology Inc.
New York, NY, United States
3 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source

Tech stack

Clean Code Principles HTML JavaScript (Programming Language) Agile Methodology Databases Data Architecture Data Validation Data Files Data Integration Extract Transform Load (ETL) Data Warehousing IBM DB2
+26 more
Database Applications Database Development Database Queries IBM InfoSphere DataStage Linux File Transfer Data Flow Control IBM Cognos Business Intelligence Unix Shell Microsoft SQL Server Performance Tuning Scrum Methodology Shell Script Software Engineering SQL Databases Data Streaming System Integration Testing Tableau (Software) Enterprise Data Management Scripting Freeform SQL Integration Tests Information Technology Data Analytics Data Management Software Coding

Job description

Seeking a highly skilled and analytical Senior ETL Developer to join our Information Technology Division and support enterprise data integration, ETL development, and data warehouse initiatives. The primary objective of this role is to design, develop, deploy, maintain, and optimize robust IBM DataStage ETL solutions supporting agency databases, data warehouses, cross-agency data exchanges, vendor feeds, and open-data initiatives. The ideal candidate will have strong hands-on experience with IBM DataStage 11.7.x+, Linux/Shell scripting, DB2, SQL Server, and complex SQL development. This role requires an individual who can independently troubleshoot production ETL processes, participate in UAT and System Integration Testing, collaborate with QA, DBA, architecture, and application development teams, and contribute to the continuous improvement of the organization’s data architecture and development practices., * ETL Development & Architecture: Design, develop, and maintain scalable and reliable ETL jobs using IBM DataStage, following established technical specifications, architecture standards, coding standards, and development best practices.

  • DataStage Job Design: Develop complex DataStage parallel jobs, job sequences, transformations, mappings, and data integration workflows to support enterprise data movement and business requirements.
  • Production Support: Troubleshoot DataStage job failures, investigate root causes, resolve production issues, and provide ongoing operational support for existing ETL processes.
  • Data Integration: Develop ETL solutions for data exchanges between agency databases, data warehouses, external agencies, vendors, and open-data platforms.
  • Job Deployment: Manage and execute DataStage job deployments across development, testing, UAT, and production environments, ensuring appropriate configuration and release procedures are followed.
  • Performance Optimization: Monitor ETL processes, identify performance bottlenecks, optimize DataStage jobs and SQL queries, and implement improvements to increase processing efficiency and reliability.
  • SQL & Database Development: Develop complex SQL queries and perform data validation, transformation, reconciliation, and optimization across DB2 and SQL Server environments.
  • File Transfer Automation: Develop and maintain Linux shell scripts and file-transfer processes to securely exchange data files with internal business units, external agencies, and third-party vendors.
  • Testing & Quality Assurance: Perform developer-level testing of DataStage jobs and collaborate closely with QA teams to ensure ETL functionality, data quality, integration points, and defect resolutions are thoroughly validated.
  • UAT & System Integration Testing: Support User Acceptance Testing (UAT) and participate in System Integration Testing (SIT) to validate end-to-end data flows and application integrations.
  • Technical Documentation: Create and maintain technical design documents, ETL specifications, data-flow documentation, deployment documentation, troubleshooting guides, and other technical artifacts.
  • Architecture & Continuous Improvement: Contribute to the evolution of the organization’s data architecture, ETL technology stack, development methodologies, and engineering processes.
  • Cross-Functional Collaboration: Partner with solution architects, application developers, DBAs, QA engineers, technical staff, operations managers, project managers, and business stakeholders to define and implement effective data integration solutions.
  • Mentorship: Mentor junior ETL developers, conduct knowledge-sharing sessions, promote development best practices, and provide technical guidance on DataStage and data integration solutions.

Requirements

We currently have an opening for the position of Senior ETL Developer with Data stage and Enterprise Data Integration. Candidates must have strong experience working with government agencies., * Experience: 10+ years of dedicated professional experience utilizing IBM DataStage (version 11.7.x and higher) for enterprise data integration.

  • OS & Scripting: Strong, non-negotiable proficiency in Linux operating systems and Linux shell scripting.
  • Data Integration Tools: Practical hands-on experience utilizing Kettle alongside DataStage.
  • Database & Querying: Advanced proficiency in IBM DB2 and SQL Server, with a proven ability to write complex SQL queries for data-driven validation and optimization.
  • Development Methodologies: Well-versed in modern software development methodologies including Agile, Scrum, and Iterative frameworks.
  • Problem Solving & Independence: Self-motivated and self-directed learner with the exceptional ability to adapt to a constantly changing environment, handle multiple tasks simultaneously, and deliver end-to-end solutions with minimal supervision.
  • Communication & Teamwork: Strong interpersonal skills coupled with articulate verbal and written communication abilities to collaborate effectively across technical and non-technical teams.
  • Testing: Experience performing developer-level testing and collaborating with QA teams during SIT, UAT, integration testing, and defect resolution.

Preferred Qualifications

  • Experience with JavaScript and HTML for supporting data-driven applications and integration requirements.
  • Experience with reporting and visualization tools such as Cognos 11.x and Tableau.
  • Exposure to modern data integration technologies and willingness to learn and adopt new tools and technologies.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · World Congress 2025

2:21 min

Projecting external HTML content using default and named slots

Rowdy Rabouw Rowdy Rabouw · World Congress 2022

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:55 min

Demonstrating .NET installation on Debian and Azure Linux

Silvano Coriani Silvano Coriani · Europe 2026 Virtual

6:12 min

Streaming HTML content natively using declarative processing instructions

Chris Heilmann Chris Heilmann +2 · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

Videos

See all

Related articles

See all