Ab initio Admin

SPARTAN LLC
Raleigh, NC, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$82,224.0 - $99,022.0
Working hours
Regular working hours
Job source

Tech stack

Query Performance Agile Methodology Amazon Web Services Amazon S3 Business Analytics Applications Data Analysis Component-Based Software Engineering Bash Shell Big Data Cloud Computing Code Review Computer Programming
+31 more
Continuous Delivery Data Integration Extract Transform Load (ETL) Database Design Apache Hadoop Hadoop Distributed File System Monitoring of Systems Apache Hive Iterative and Incremental Development Job Scheduling Python (Programming Language) Meta-Data Management Microsoft SQL Server Oracle Databases Oracle (Applications) Performance Tuning Scrum Methodology Cloud Services Azure Data Lake Shell Script Talend Visual Analytics Freeform SQL Data Ingestion Apache Spark Ab Initio Vba Programming Language Data Delivery Restful APIs Looker Analytics Data Pipelines

Job description

  • Design, develop, and optimize complex ETL (Extract, Transform, Load) processes using Ab Initio to support enterprise data warehousing and analytics initiatives.
  • Collaborate with cross-functional teams to gather requirements and translate them into scalable data solutions aligned with business goals.
  • Integrate data from various sources including Hadoop, Apache Hive, Spark, Oracle, SQL Server, and cloud platforms such as AWS and Azure Data Lake.
  • Develop and maintain automated workflows for data ingestion, transformation, and validation ensuring accuracy and efficiency.
  • Implement best practices for database design, data modeling, and performance tuning in environments utilizing Informatica, Talend, or similar tools.
  • Write complex SQL queries and scripts in Python or Shell scripting to facilitate data analysis and model training tasks.
  • Support agile development processes by participating in sprint planning, code reviews, and continuous improvement initiatives.
  • Monitor system performance, troubleshoot issues proactively, and implement enhancements to improve reliability and scalability of data pipelines.

Requirements

Do you have experience in Data modeling projects?, We are seeking a dynamic and detail-oriented Ab Initio Admin to join our innovative data engineering team. In this role, you will be instrumental in designing, developing, and maintaining robust data pipelines and solutions that drive critical business insights. Your expertise will enable seamless integration of large-scale data from diverse sources, ensuring high-quality data delivery for analytics, reporting, and decision-making. This position offers an exciting opportunity to work with cutting-edge technologies and contribute to the advancement of our data ecosystem., * Proven experience with Ab Initio development including graph design, metadata management, and job scheduling.

  • Strong knowledge of AWS cloud services such as S3, Lambda, Redshift; experience with Azure Data Lake is a plus.
  • Proficiency in Java programming for custom component development within Ab Initio or related frameworks.
  • Extensive experience working with Big Data technologies like Hadoop ecosystem (HDFS), Spark, Hive for large-scale data processing.
  • Hands-on expertise with SQL Server, Oracle databases; familiarity with database design principles is essential.
  • Knowledge of Looker or other BI tools for creating dashboards and visual analytics.
  • Familiarity with ETL tools such as Informatica or Talend for comprehensive data integration solutions.
  • Experience with RESTful APIs for integrating external systems into the data pipeline architecture.
  • Strong analysis skills to interpret complex datasets and support model training activities using Python or other analytical tools.
  • Ability to design efficient database schemas and optimize query performance for large datasets.
  • Knowledge of Shell Scripting (Bash), VBA scripting for automation tasks within the data environment.
  • Experience working within Agile methodologies to ensure iterative development and continuous delivery of value. Join us to leverage your Ab Initio expertise in a fast-paced environment where innovation meets impact!

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann +3 · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:44 min

Automating storage savings with S3 intelligent tiering

Sébastien Stormacq · WWC 2021

Videos

See all

Related articles

See all