> Markdown version of [/jobs/ext/1775444-lead-consultant-data-management-data-integration-datastage](https://www.wearedevelopers.com/jobs/ext/1775444-lead-consultant-data-management-data-integration-datastage). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Consultant | Data Management - Data Integration | DataStage - **Company:** Ipolarity LLC - **Location:** Minneapolis, MN, United States - **Experience:** Expert - **Salary:** $100,000.0 - $140,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Data Analysis, Microsoft Azure, Unix, Cloud Computing, Databases, Continuous Integration, Data Integration, Extract Transform Load (ETL), IBM InfoSphere DataStage, Github, Java Web Services, Python (Programming Language), PostgreSQL, MySQL, NoSQL, Oracle (Applications), Cloud Services, SQL Databases, Teradata SQL, GitHub Copilot, Office365, Snowflake, Data Build Tool (dbt), Spring-boot, Git, Kubernetes, Apache Kafka, Azure AKS, Data Management, Xl Deploy, Data Pipelines, Spring Batch, Docker, Databricks, Microservices - **Published:** July 19, 2026 - **Apply:** https://www.careerjet.com/jobad/us2b495b3627dc0cb78fd4c97b0478f385 ## About the Role 3+ years of Strong experience with java micro-services, Spring Boot, Spring Batch 3+ years of Experience hosting micro services on cloud environment - specifically, experience in Kubernetes - experience with Docker container management. 3+ Years of experience with Kafka Producer, Kafka Consumer and Kafka Streams OR 3+ years of Strong experience with Datastage PX ETL development. AND 3+ Years of experience with database such as MySQL, Oracle, Postgres. 3+ Years of strong CI/CD experience, including building and deploying and maintaining cloud micro services o Git, Github, Github actions, Github Pipelines. o Docker o XL Deploy o General CI/CD pipeline experience Required AI Skills: - All contractor resources are expected to demonstrate baseline proficiency in enterprise-approved AI tools as part of their day-to-day responsibilities. This includes, but is not limited to: -Consistent Use: Maintain a minimum of 90% weekly usage of AI tools such as GitHub Copilot, Microsoft 365 Copilot, and other GenAI platforms approved by the enterprise. ## Description Must Have Skills: ETL Datastage, Unix, Airflow, Teradata, Python,Databricks and Snowflake Nice to Have Skills: SQL, , Azure ,Kubernetes Services, ,DBT(Data Build Tool) Detailed Job Description -Design and develop solution for the current project through cloud-hosted Java Microservices/Kafka streams and Datastage ETL jobs. -Hands on work with deliverables of java services, cloud solutions, data pipelines, Kafka streaming and Datastage PX to implement solution. -Help create strategic direction for how to transform other components of the app using modern technologies (Kafka, services, Sql and NoSQL DB) -Help triage and fix issues with solution in Production. -Monitor and resolve issues with jobs in production -Work on and resolve open incident tickets, Applied Productivity: Leverage AI tools to enhance coding, documentation, data analysis, and decision-making workflows. -Continuous Learning: Stay current with evolving AI capabilities and features, and apply them to improve delivery quality and velocity Minimum years of experience >10 years Certifications Needed :No Top 3 responsibilities you would expect the Subcon to shoulder and execute Development Testing and Support Interview Process (Is face to face required?) No Any additional information you would like to share about the project specs/ nature of work Project Code: Child code for DNA ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [WeAreDevelopers LIVE - Node and Package Security](https://www.wearedevelopers.com/videos/2138-wearedevelopers-live-node-and-package-security) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [Blueprints for Success: Steering a Global Data & AI Architecture](https://www.wearedevelopers.com/videos/1577-blueprints-for-success-steering-a-global-data-ai-architecture) ## Related Articles - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)