Senior Data Engineer - MDM & Cloud Data Integration - Remote

Zaass Consulting, LLC
New York, NY, United States
1 day ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Multitier Architecture Application Programming Interfaces (APIs) Amazon Web Services Applications Architecture Unit Testing Microsoft Azure Big Data Cloud Computing Cloud Database Computer Programming Databases
+40 more
Data Dictionary Data Integration Extract Transform Load (ETL) Data Transformation Data Security Data Stores Data Systems Relational Databases Perl (Programming Language) Github Python (Programming Language) PostgreSQL Metadata Microsoft SQL Server MySQL Oracle (Applications) Cloud Services Standard Sql Service-Oriented Architecture Simple Object Access Protocol (SOAP) SQL Databases SQL Server Integration Services Subversion System Testing Web Services Enterprise Data Management Data Processing Sql Optimization Informatica Powercenter Oracle 10g/11g Snowflake Spring-boot Software Application Programming Git Amazon Relational Database Service Data Management Restful APIs Software Version Control Data Pipelines Vulnerability Analysis

Job description

Seeking an experienced Senior Data Engineer to support the design, implementation, and operation of enterprise data-management and integration solutions for City agencies.

In this role, you will help build the City’s Master Data Management (MDM) platform, integrate data from multiple agency sources, develop data pipelines and APIs, and support analytics products that improve operational efficiency and public service delivery. You will work closely with technical leads, data engineers, and City Cyber Command to deliver secure, scalable, cloud-ready data solutions., Β· Support implementation of the MDM Person and Business domains, integrating data from multiple sources, web services, and APIs.

Β· Develop architectural blueprints that use MDM as a foundational service, including unified profiles for business owners and related transactions.

Β· Coordinate senior data engineers building pipelines into the MDM and other enterprise data platforms.

Β· Review and improve ETL strategies for extracting, transforming, and loading data from diverse source systems using SQL, cloud, and big-data technologies.

Β· Develop and maintain APIs for data access, data landing, and downstream consumption in target data stores.

Β· Build analytics tools that provide actionable insights into customer engagement, operational efficiency, and business performance.

Β· Develop custom code and integration services that connect systems seamlessly.

Β· Perform unit testing, support system testing, troubleshoot defects, and maintain production applications.

Β· Create and maintain technical documentation, including data dictionaries, source-to-target mappings, database policies, and source-code repositories.

Β· Coordinate security scans and support application-security accreditation with the City’s Cyber Command unit.

Β· Provide operations, maintenance, and enhancement support for existing applications and data platforms.

Requirements

Candidates must meet all of the following requirements:

Β· At least 8+ years of experience managing the development and implementation of large technology projects.

Β· At least 3+ years of hands-on experience with Master Data Management (MDM) implementations.

Β· At least 8 years of experience writing advanced SQL.

Β· At least 8 years of experience automating, copying, transferring, and manipulating data operations that were previously manual.

Β· Experience with enterprise ETL tools such as Informatica PowerCenter, IICS, SSIS, or comparable platforms.

Β· Hands-on experience with AWS or Microsoft Azure cloud services.

Β· In-depth knowledge of SQL and relational database solutions.

Β· Experience modeling database schemas for large datasets.

Β· Experience developing cloud-ready applications.

Β· Programming experience with Python, Java, and/or Perl.

Preferred qualifications

Β· 5+ years of hands-on development experience with Informatica PowerCenter and B2B Data Transformation.

Β· Experience with Oracle 10g/11g, SQL Server, and/or database appliances.

Β· Experience with Oracle, Microsoft SQL Server, MySQL, Amazon RDS, and/or PostgreSQL.

Β· Experience with cloud data platforms such as AWS, Azure, and Snowflake.

Β· Knowledge of metadata-driven enterprise reporting platforms.

Β· Experience developing applications using the Java Spring Boot framework.

Β· Strong knowledge of service-oriented architecture, including SOAP and RESTful web services.

Β· Experience with three-tier application architecture.

Β· Experience with Agile delivery and version-control tools such as Git, GitHub, and Subversion.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…