Lead Consultant | Data Management - Data Integration | DataStage

Ipolarity LLC
Minneapolis, MN, United States
about 2 months ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Compensation
$100,000.0 - $140,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Airflow Data Analysis Microsoft Azure Unix Cloud Computing Databases Continuous Integration Data Integration Extract Transform Load (ETL) IBM InfoSphere DataStage Github
+25 more
Java Web Services Python (Programming Language) PostgreSQL MySQL NoSQL Oracle (Applications) Cloud Services SQL Databases Teradata SQL GitHub Copilot Office365 Snowflake Data Build Tool (dbt) Spring-boot Git Kubernetes Apache Kafka Azure AKS Data Management Xl Deploy Data Pipelines Spring Batch Docker Databricks Microservices

Job description

Must Have Skills: ETL Datastage, Unix, Airflow, Teradata, Python,Databricks and Snowflake Nice to Have Skills: SQL, , Azure ,Kubernetes Services, ,DBT(Data Build Tool) Detailed Job Description -Design and develop solution for the current project through cloud-hosted Java Microservices/Kafka streams and Datastage ETL jobs. -Hands on work with deliverables of java services, cloud solutions, data pipelines, Kafka streaming and Datastage PX to implement solution. -Help create strategic direction for how to transform other components of the app using modern technologies (Kafka, services, Sql and NoSQL DB) -Help triage and fix issues with solution in Production. -Monitor and resolve issues with jobs in production -Work on and resolve open incident tickets, Applied Productivity: Leverage AI tools to enhance coding, documentation, data analysis, and decision-making workflows. -Continuous Learning: Stay current with evolving AI capabilities and features, and apply them to improve delivery quality and velocity Minimum years of experience >10 years Certifications Needed :No Top 3 responsibilities you would expect the Subcon to shoulder and execute Development Testing and Support Interview Process (Is face to face required?) No Any additional information you would like to share about the project specs/ nature of work Project Code: Child code for DNA

Requirements

3+ years of Strong experience with java micro-services, Spring Boot, Spring Batch 3+ years of Experience hosting micro services on cloud environment

  • specifically, experience in Kubernetes
  • experience with Docker container management. 3+ Years of experience with Kafka Producer, Kafka Consumer and Kafka Streams OR 3+ years of Strong experience with Datastage PX ETL development. AND 3+ Years of experience with database such as MySQL, Oracle, Postgres. 3+ Years of strong CI/CD experience, including building and deploying and maintaining cloud micro services o Git, Github, Github actions, Github Pipelines. o Docker o XL Deploy o General CI/CD pipeline experience Required AI Skills:

  • All contractor resources are expected to demonstrate baseline proficiency in enterprise-approved AI tools as part of their day-to-day responsibilities. This includes, but is not limited to: -Consistent Use: Maintain a minimum of 90% weekly usage of AI tools such as GitHub Copilot, Microsoft 365 Copilot, and other GenAI platforms approved by the enterprise.

About the company

  • $100,000-140,000 per year Cargill is committed to providing food and agricultural solutions to nourish the world in a safe, responsible, and sustainable way. Sitting at the heart of the supply chain, we par…

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:03 min

Microsoft integrating native Unix coreutils into Windows environments

Chris Heilmann +2 · LIVE

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

1:34 min

Transitioning from traditional software development to artificial intelligence consulting

Patrick Schnell Patrick Schnell · Coffee With Developers

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all