Lead Engineer - II_Data engineering on cloud

We are looking for an experienced GCP Data Engineer to design and build an automated solution for data discovery, end-to-end lineage, metadata management, and data quality across multiple GCP projects. The solution will trace data movement from source systems through GCP processing layers, store metadata centrally in BigQuery, and integrate lineage information with Collibra using OpenLineage APIs, * Build programmatic upstream and downstream data lineage across multiple GCP projects and BigQuery datasets.

• Discover datasets, tables, views, stored procedures, jobs, and other relevant data assets.
• Trace data movement and intermediate processing through BigQuery, Dataflow, Cloud Data Fusion, stored procedures, Cloud Storage, and related GCP services.
• Use GCP Data Lineage/Dataplex APIs, BigQuery INFORMATION_SCHEMA, job metadata, and other GCP APIs to collect and enrich lineage information.
• Capture available table-level and column-level lineage transformation details, and pipeline execution metadata.
• Extract data quality rules, scans, and results using Dataplex and related metadata services.
• Develop Python/SQL-based services and pipelines to collect, normalize, validate, and store metadata in BigQuery.
• Generate standardized OpenLineage JSON/events and integrate lineage metadata with Collibra.
• Implement secure cross-project access using GCP service accounts, IAM roles, and least-privilege principles.
• Build monitoring, logging, error handling, and audit capabilities for metadata and lineage processing.
• Support AI/agentic workflows for metadata analysis, lineage enrichment, and identification of lineage or data quality gaps.

• 7+ Years, * Engineering Degree - BE/ME/BTech/MTech/BSc/MSc.

• Technical certification in multiple technologies is desirable.

Mandatory skills: -

• Strong hands-on experience with Python and SQL
• Strong experience with Google BigQuery, including metadata and INFORMATION_SCHEMA`
• Experience with Dataflow and/or Cloud Data Fusion
• Experience integrating with GCP APIs and REST APIs
• Understanding of data lineage, metadata management, data quality, and data governance
• Experience with GCP IAM, service accounts, and cross-project access
• Experience designing and supporting production-grade data pipelines

Good to have:

• Dataplex / GCP Data Lineage API
• Collibra and OpenLineage
• Cloud Run and Cloud Storage
• Terraform / Infrastructure as Code
• Vertex AI / agentic or LLM-based workflows
• SQL parsing and transformation dependency analysis
• Enterprise data governance and metadata platforms

We focus on building highly motivated engineering teams and thought leaders with an entrepreneurial mindset, centered on our core values of Passion, Respect, Openness, Unity, and Depth (PROUD) of knowledge. Our success lies in creating a fun, transparent, non-hierarchical, diverse work culture that focuses on continuous learning and work-life balance.

Rated by our employees as the ‘Great Place to Work for’ according to the Great Place to Work survey. We offer you a comprehensive set of benefits to ensure that you have a long and rewarding career with us.

Our EVP

Be You Be Awesome is our EVP and it reflects our continuing efforts to create CitiusTech as a great place to work where our employees can thrive, both personally and professionally. It encompasses the unique benefits and opportunities we offer to support your growth, well-being, and success throughout your journey with us and beyond. Together with our clients, we are solving some of the greatest healthcare challenges and positively impacting human lives. Welcome to the world of Faster Growth, Higher Learning, and Stronger Impact.

At CitiusTech, we constantly strive to solve the industry’s greatest challenges

with technology, creativity, and agility. With over 8,500 healthcare technology professionals worldwide, CitiusTech powers healthcare digital innovation, business transformation, and industry-wide convergence for over 140 organizations through next-generation technologies, solutions, and products. We aim to accelerate the transition to a human-first, sustainable, and digital healthcare ecosystem with the world’s leading Healthcare and life sciences organizations and our partners.

Here is an opportunity for you to make a difference and collaborate with global leaders to shape the future of healthcare and positively impact human lives., CitiusTech is a global technology services, consulting, and business solutions enterprise 100% focused on the healthcare and life sciences industry. We enable 140+ enterprises to build a human-first ecosystem that is efficient, effective, and equitable. Leveraging deep domain expertise and next-generation technologies including AI, Cloud, Data, and Intelligent Automation, we assist our clients to realize their vision, accelerate transformation, and achieve business outcomes. With 7,700+ healthcare technology professionals worldwide, CitiusTech powers digital innovation, business transformation, and industry-wide convergence through next-generation technologies, solutions, and products.