> Markdown version of [/jobs/ext/1789887-lead-data-automation-and-excellence](https://www.wearedevelopers.com/jobs/ext/1789887-lead-data-automation-and-excellence). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead-Data Automation and Excellence - **Company:** Johnson & Johnson - **Location:** Hopewell Township, NJ, United States - **Experience:** Expert - **Salary:** $94,000.0 - $151,800.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Architectural Patterns, Data Architecture, Information Engineering, Data Profiling, Digital Assets, Human-Computer Interaction, Metadata, Systems Development Life Cycle, DataOps, Software Engineering, Data Streaming, Large Language Models, Prompt Engineering, Technical Debt, Change Data Capture, Event Driven Architecture, Information Technology, Apache Kafka, Data Management, Data Pipelines - **Published:** July 11, 2026 - **Apply:** https://www.juju.com/job/00000000gfbpom ## About the Role Bachelor's Degree in Computing or similar discipline Required Knowledge, Skills and Abilities: Overall Experience + Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field. + 7+ years experience in data engineering, including 3-5+ years in a senior or technical lead role. + Strong experience designing, building, and operating data pipelines across batch, streaming, and near-real-time use cases. + 5+ years experience working with modern layered or medallion architectures, ideally within a federated data product model. + Proven ability to mentor engineers, lead by technical influence, and collaborate effectively across product, architecture, and platform teams. Additional Experience * 3+ years hands-on experience with Kafka, event-driven architectures, and CDC-based ingestion and curation patterns. * 4+ years experience implementing and optimizing CI/CD pipelines aligned with enterprise SDLC standards for data platforms. * Working knowledge of AI and GenAI concepts relevant to data platforms, including LLMs, prompt engineering, ontologies, metadata enrichment, and data profiling. * Strong understanding of data quality, lineage, governance, contextualization, and cataloging to support AI-ready data assets. Required Skills: Preferred Skills: Agile Product Development, Analytical Reasoning, Coaching, Collaboration, Competitive Landscape Analysis, Critical Thinking, Customer Alignment, Demand Forecasting, Human-Computer Interaction (HCI), Organizing, Product Development, Product Improvements, Product Strategies, Requirements Analysis, Research and Development, Software Development Life Cycle (SDLC), Software Development Management, Stakeholder Management, Technical Credibility, Technical Writing, Technologically Savvy ## Description The Technology Lead, Data Automation and Excellence is a senior individual contributor and technical leader responsible for leading a technology squad in the plan, design, monitor build and operation of high-quality, scalable, and AI-ready data assets. This role provides hands-on technical leadership, drives automation of curating using AI agents for data management, sets engineering standards within the squad, and ensures alignment with enterprise architecture, platform patterns, and the SDLC toolchain. The Technology Lead combines deep data engineering expertise with strong architectural judgement, mentoring capability, and modern AI for Data management experience and knowledge. Major Duties & Responsibilities: + **Solution Architecture & Technical Enablement** + Responsible to drive solution architecture for data across ingestion, curation, and consumption layers. + Guide squad members in problem-solving complex technical challenges and support implementation of sound, scalable solutions. + Shape technology standards and framework to ensure adherence to coding standards, architectural patterns, and data engineering best practices. + Mentor and coach engineers to raise overall technical maturity and delivery quality within the squad. + Lead the technical design of data assets using a medallion architecture (Bronze, Silver, Gold) working with the Technical Product owners within a federated data product squad model. + Recommend and introduce improved technical approaches to data architecture, modelling tools, and solution design to enhance scalability and maintainability. + Drive technical improvements in data curation practices using Change Data Capture (CDC) and event-driven curation patterns. + Design and guide implementation of event-driven and streaming architectures, including Kafka-based solutions integrated with batch pipelines. + **Operational Excellence & SDLC** + Improve operational efficiency through optimization of CI/CD pipelines aligned with the enterprise SDLC toolchain. + Promote automation working in partnership with information architects by introducing tools and AI driven capabilities across testing, deployment, data quality validation, and observability to reduce manual effort and operational support risk. + Actively manage and prevent accumulation of technical debt while balancing delivery commitments. + **AI Enablement & Data Readiness** + Apply data engineering best practices alongside strong AI and GenAI literacy, including: + Prompt engineering and AI-assisted development + Large Language Models (LLMs) and GenAI concepts + Data profiling and automated asset creation + Collaborate with architects, platform teams, and product owners to ensure data products are designed with AI readiness and reuse in mind. Other Duties : + Partner with Product Owners to refine technical requirements, define acceptance criteria, and support backlog shaping. + Collaborate with other Lead Engineers to align on standards, manage cross-squad dependencies, and resolve shared technical challenges. + Stay current with emerging data engineering, streaming, and AI technologies and assess their applicability within the platform ecosystem. + Support onboarding of new engineers by providing guidance on tools, frameworks, and engineering practices. ## Related Videos - [A Data Mesh needs Open Metadata](https://www.wearedevelopers.com/videos/505-a-data-mesh-needs-open-metadata) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [How to Benchmark Your Apache Kafka](https://www.wearedevelopers.com/videos/76-how-to-benchmark-your-apache-kafka) - [Blueprints for Success: Steering a Global Data & AI Architecture](https://www.wearedevelopers.com/videos/1577-blueprints-for-success-steering-a-global-data-ai-architecture) - [Let's Get Started With Apache Kafka® for Python Developers](https://www.wearedevelopers.com/videos/565-let-s-get-started-with-apache-kafka-for-python-developers) - [Crafting Custom Frameworks with Rust: A Deep Dive into Procedural Macros](https://www.wearedevelopers.com/videos/849-crafting-custom-frameworks-with-rust-a-deep-dive-into-procedural-macros) ## Related Articles - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Résumé-Driven Development: How IT trends affect the job market for software developers](https://www.wearedevelopers.com/magazine/59-resume-driven-development-how-it-trends-affect-the-job-market-for-software-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [What’s the Difference between a Junior, Mid, and Senior Developer?](https://www.wearedevelopers.com/magazine/238-what-s-the-difference-between-a-junior-mid-and-senior-developer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)