Data Infrastructure Engineer

Jose Merciline
New York, NY, United States
2 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) CA Workload Automation Ae Big Data Information Systems Databases Data Distribution Service Data Infrastructure Data Integrity Persistent Data Structure Data Warehousing IBM DB2 Relational Databases
+18 more
Distributed Computing Environment Distributed Data Store Greenplum Event-Driven Programming Graphical User Interface Job Scheduling Python (Programming Language) Online Transaction Processing Oracle (Applications) Systems Development Life Cycle Software Engineering Systems Architecture Teradata SQL Transaction Data Transaction Processing (Computing) Data Processing Apache Spark Information Technology

Requirements

Credit Risk, Data Modeling, Data Warehousing, Business Analysis, Transaction Processing/Management, Information Technology & Information Systems, Data Processing, Technical Analysis, Financial Services, Graphical User Interface (GUI), This position is for a hands-on Developer in the Distributed Data Development team of the North America based Credit Risk Technology group. The successful candidate will have an opportunity to work closely with the Credit Risk business unit, IT business analysts, GUI development teams and Data providers and consumers to deliver Credit Risk Data Warehouse systems related projects. The candidate must have minimum 10 years hands-on IT experience, preferably in the financial services industry working on all aspects of SDLC with focus on large volume data processing applying complex business rules, performing transformation, aggregation and designing data persistence model for Transactional Data Processing (OLTP) as well as Data Warehouse. Must have strong ability to work on multiple IT projects simultaneously, working with the stake holders, clients and other system owners to drive the projects to successful completion. Must have previous involvement in data modeling and/or systems architecture. Responsibilities will include technical analysis, design, development and perform enhancements.

The candidate will participate in all of the following activities: -

-Hands-on development experience working with large data volumes, building distributed processing using Java or Python on Spark, data frames, externalizing business rules etc.

-Strong knowledge of database table partitions, data distribution, parallel loads and extracts working on DB2 DPF or Greenplum or other big data technologies

-Build batch vs. event driven data processing. Design for high level of concurrency to ensure data integrity without compromising performance

-Working in a agile squad as a contributor, working with other developers towards a common goal

-Modeling and implementing database schemas

-Coming up with system architecture/re-design proposals for greater efficiency and ease of maintenance and developing software to turn proposals into implementations

Skills Required:

-Strong hands-on knowledge of Python or Java as a distributed data developer, working on large data volumes (20m+ rows per day)

-Ability to deliver multiple simultaneous projects under pressure of regulatory driven deadlines

-10+ years of relational database experience with emphasis on data processing as described above

-Hands-on experience with Greenplum / DB2 / Teradata / Oracle

-Excellent analytical ability

-Strong collaboration and communication skills

Skills Desired :

-Credit risk knowledge

-Job scheduler knowledge

-Autosys

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…