Ab initio Admin

SPARTAN LLC
Raleigh, United States of America
31 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
$ 99K

Job location

Raleigh, United States of America

Tech stack

Query Performance
Agile Methodologies
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Business Analytics Applications
Data analysis
Component-Based Software Engineering
Bash
Big Data
Cloud Computing
Code Review
Computer Programming
Continuous Delivery
Data Integration
ETL
Database Design
Hadoop
Hadoop Distributed File System
Monitoring of Systems
Hive
Iterative and Incremental Development
Job Scheduling
Python
Meta-Data Management
Microsoft SQL Server
Oracle
Oracle Applications
Performance Tuning
Scrum
Cloud Services
Azure
Shell Script
Talend
Visual Analytics
Freeform SQL
Data Ingestion
Spark
Ab Initio
Vba Programming Language
Data Delivery
REST
Looker Analytics
Data Pipelines

Job description

  • Design, develop, and optimize complex ETL (Extract, Transform, Load) processes using Ab Initio to support enterprise data warehousing and analytics initiatives.
  • Collaborate with cross-functional teams to gather requirements and translate them into scalable data solutions aligned with business goals.
  • Integrate data from various sources including Hadoop, Apache Hive, Spark, Oracle, SQL Server, and cloud platforms such as AWS and Azure Data Lake.
  • Develop and maintain automated workflows for data ingestion, transformation, and validation ensuring accuracy and efficiency.
  • Implement best practices for database design, data modeling, and performance tuning in environments utilizing Informatica, Talend, or similar tools.
  • Write complex SQL queries and scripts in Python or Shell scripting to facilitate data analysis and model training tasks.
  • Support agile development processes by participating in sprint planning, code reviews, and continuous improvement initiatives.
  • Monitor system performance, troubleshoot issues proactively, and implement enhancements to improve reliability and scalability of data pipelines.

Requirements

Do you have experience in Data modeling projects?, We are seeking a dynamic and detail-oriented Ab Initio Admin to join our innovative data engineering team. In this role, you will be instrumental in designing, developing, and maintaining robust data pipelines and solutions that drive critical business insights. Your expertise will enable seamless integration of large-scale data from diverse sources, ensuring high-quality data delivery for analytics, reporting, and decision-making. This position offers an exciting opportunity to work with cutting-edge technologies and contribute to the advancement of our data ecosystem., * Proven experience with Ab Initio development including graph design, metadata management, and job scheduling.

  • Strong knowledge of AWS cloud services such as S3, Lambda, Redshift; experience with Azure Data Lake is a plus.
  • Proficiency in Java programming for custom component development within Ab Initio or related frameworks.
  • Extensive experience working with Big Data technologies like Hadoop ecosystem (HDFS), Spark, Hive for large-scale data processing.
  • Hands-on expertise with SQL Server, Oracle databases; familiarity with database design principles is essential.
  • Knowledge of Looker or other BI tools for creating dashboards and visual analytics.
  • Familiarity with ETL tools such as Informatica or Talend for comprehensive data integration solutions.
  • Experience with RESTful APIs for integrating external systems into the data pipeline architecture.
  • Strong analysis skills to interpret complex datasets and support model training activities using Python or other analytical tools.
  • Ability to design efficient database schemas and optimize query performance for large datasets.
  • Knowledge of Shell Scripting (Bash), VBA scripting for automation tasks within the data environment.
  • Experience working within Agile methodologies to ensure iterative development and continuous delivery of value. Join us to leverage your Ab Initio expertise in a fast-paced environment where innovation meets impact!

Apply for this position