Ab Initio Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+23 more
Job description
Immediate need for a talented Ab Initio Data Engineer. This is a 06+ Months Contract opportunity with long-term potential and is located in Berkeley Heights, NJ (Onsite). Please review the job description below and contact me ASAP if you are interested.Job ID:26-23682 Pay Range: $45 - $53/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities:Design, develop, and maintain complex ETL graphs using Ab Initio GDE (Graphical Development Environment)Architect end-to-end data integration solutions spanning multiple source/target systems (RDBMS, mainframe, flat files, message queues)Optimize graph performance - parallelism, partitioning (broadcast, hash, range), layout tuning, checkpointingLead development using Ab Initio components: Co>Operating System, EME (Enterprise Meta>Environment), Conduct>It, Data Profiler, Continuous FlowsOwn metadata management and data lineage within EMEDesign and implement CDC (Change Data Capture) and near-real-time data pipelinesTroubleshoot production job failures, perform root-cause analysis, and implement fixes with minimal downtimeDefine coding standards, review peer-developed graphs, and enforce best practicesMentor junior/mid-level Ab Initio developersCollaborate with data architects, DBAs, and business analysts to translate requirements into technical designKey Requirements and Technology Experience:Must have skills: - Ab Initio, GDE and Unix/LinuxBachelor’s degree in Computer Science, Engineering, or related field7+ years of ETL development experience, with 5+ years specifically in Ab InitioStrong hands-on expertise with Ab Initio GDE, Co>Op, EME, and Conduct>ItDeep understanding of parallel processing concepts and Ab Initio partitioning/multi-file system (MFS)Strong SQL skills and experience with major RDBMS (DB2)Experience with Unix/Linux shell scriptingSolid understanding of data warehousing concepts (dimensional modeling, SCDs, star/snowflake schemas)Experience with KafkaStrong debugging and performance-tuning skills for large-volume data processingExperience with mainframe data integration (COBOL copybooks, VSAM, flat files)Exposure to Kubernetes, openshift Familiarity with Hadoop/Spark ecosystems and hybrid ETL architecturesKnowledge of API-based or streaming integration (Kafka)Prior experience as a technical lead or in a client-facing architecture roleStrong analytical and problem-solving skills for complex data issuesAbility to lead design discussions and drive technical consensusEffective mentorship and knowledge-sharing across the teamClear communication with both technical and business stakeholdersGood Communication skills5 days Work from Office at Berkley Heights, NJTeam PlayerAbility to work in a changing environmentStrong problem solving and analytical skillsAbility to work independently or within a teamManage day-to-day challenges and communicate developmental risks with the technical team Our client is a leading IT Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration. Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.
Requirements
- Must have skills: - Ab Initio, GDE and Unix/Linux
- Bachelor’s degree in Computer Science, Engineering, or related field
- 7+ years of ETL development experience, with 5+ years specifically in Ab Initio
- Strong hands-on expertise with Ab Initio GDE, Co>Op, EME, and Conduct>It
- Deep understanding of parallel processing concepts and Ab Initio partitioning/multi-file system (MFS)
- Strong SQL skills and experience with major RDBMS (DB2)
- Experience with Unix/Linux shell scripting
- Solid understanding of data warehousing concepts (dimensional modeling, SCDs, star/snowflake schemas)
- Experience with Kafka
- Strong debugging and performance-tuning skills for large-volume data processing
- Experience with mainframe data integration (COBOL copybooks, VSAM, flat files)
- Exposure to Kubernetes, openshift
- Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures
- Knowledge of API-based or streaming integration (Kafka)
- Prior experience as a technical lead or in a client-facing architecture role
- Strong analytical and problem-solving skills for complex data issues
- Ability to lead design discussions and drive technical consensus
- Effective mentorship and knowledge-sharing across the team
- Clear communication with both technical and business stakeholders
- Good Communication skills
- 5 days Work from Office at Berkley Heights, NJ
- Team Player
- Ability to work in a changing environment
- Strong problem solving and analytical skills
- Ability to work independently or within a team
- Manage day-to-day challenges and communicate developmental risks with the technical team
Benefits & conditions
Pay Range: $45 - $53/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
About the company
Our client is a leading IT Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…