Lead Consultant | Data Management - Data Integration | DataStage
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+25 more
Job description
Must Have Skills: ETL Datastage, Unix, Airflow, Teradata, Python,Databricks and Snowflake Nice to Have Skills: SQL, , Azure ,Kubernetes Services, ,DBT(Data Build Tool) Detailed Job Description -Design and develop solution for the current project through cloud-hosted Java Microservices/Kafka streams and Datastage ETL jobs. -Hands on work with deliverables of java services, cloud solutions, data pipelines, Kafka streaming and Datastage PX to implement solution. -Help create strategic direction for how to transform other components of the app using modern technologies (Kafka, services, Sql and NoSQL DB) -Help triage and fix issues with solution in Production. -Monitor and resolve issues with jobs in production -Work on and resolve open incident tickets, Applied Productivity: Leverage AI tools to enhance coding, documentation, data analysis, and decision-making workflows. -Continuous Learning: Stay current with evolving AI capabilities and features, and apply them to improve delivery quality and velocity Minimum years of experience >10 years Certifications Needed :No Top 3 responsibilities you would expect the Subcon to shoulder and execute Development Testing and Support Interview Process (Is face to face required?) No Any additional information you would like to share about the project specs/ nature of work Project Code: Child code for DNA
Requirements
3+ years of Strong experience with java micro-services, Spring Boot, Spring Batch 3+ years of Experience hosting micro services on cloud environment
- specifically, experience in Kubernetes
-
experience with Docker container management. 3+ Years of experience with Kafka Producer, Kafka Consumer and Kafka Streams OR 3+ years of Strong experience with Datastage PX ETL development. AND 3+ Years of experience with database such as MySQL, Oracle, Postgres. 3+ Years of strong CI/CD experience, including building and deploying and maintaining cloud micro services o Git, Github, Github actions, Github Pipelines. o Docker o XL Deploy o General CI/CD pipeline experience Required AI Skills:
- All contractor resources are expected to demonstrate baseline proficiency in enterprise-approved AI tools as part of their day-to-day responsibilities. This includes, but is not limited to: -Consistent Use: Maintain a minimum of 90% weekly usage of AI tools such as GitHub Copilot, Microsoft 365 Copilot, and other GenAI platforms approved by the enterprise.
About the company
- $100,000-140,000 per year Cargill is committed to providing food and agricultural solutions to nourish the world in a safe, responsible, and sustainable way. Sitting at the heart of the supply chain, we par…
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
MLOps And AI Driven Development
Stephan Gillich - Bringing AI Everywhere
Dev Digest 132 - Binging WADFlix?