Sr. Full Stack Developer

Full Stack Java Developer with 10+ years of experience designing, building, and optimizing scalable solutions that power enterprise data governance and metadata management.

This role combines hands-on full-stack application development with integration of Collibra APIs, workflows, and Edge Server-based ingestion pipelines.

The ideal candidate will be adept at creating modern web interfaces, developing high-performance backend services, automating metadata and lineage processes, and ensuring secure, efficient data ingestion across diverse systems. Working in close collaboration with data governance, architecture, and engineering teams, this developer will play a critical role in advancing the data ecosystem through automation, innovation, and best-in-class engineering practices.

Application Development Integration

• Design and develop end-to-end Java-based web applications.
• Build RESTful APIs and microservices using Java (Spring Boot, Quarkus, or similar frameworks) to interact with Collibra APIs.
• Develop user-friendly UI components in React, Angular, or Vue.js for data governance dashboards.

Collibra API, Edge Server Workflow Automation

• Customize and extend Collibra workflows using BPMN (Camunda or similar process orchestrator engines).
• Utilize Collibra APIs, Java SDK, and Edge Servers to automate data ingestion, metadata management, and governance processes.
• Develop custom connectors and pipelines for ingesting metadata and structured/unstructured data into Collibra via Edge Servers.
• Enable real-time and batch data processing for metadata updates and lineage tracking.

Data Ingestion via Edge Server

• Configure and optimize Collibra Edge Servers for secure, efficient data ingestion from multiple sources (databases, cloud storage, and enterprise applications).
• Develop ETL/ELT pipelines for metadata extraction, transformation, and loading (e.g., using Apache Kafka, Apache NiFi, or AWS Glue).
• Implement event-driven data ingestion with message queues (RabbitMQ, Kafka) to process data efficiently.

Data Governance Metadata Management

• Work closely with Data Architects and Data Stewards to ensure proper metadata integration and governance automation.
• Automate metadata ingestion and data lineage tracking using Edge Server and Collibra API.
• Support data classification, tagging, and cataloging to enhance data discoverability.

Performance Optimization Security

• Optimize backend services for scalability, performance, and security.
• Implement authentication and authorization mechanisms (OAuth, SAML, LDAP) for secure access.
• Ensure compliance with data privacy regulations (e.g., GDPR, CCPA, FedRAMP) when handling data ingestion.

Collaboration Agile Development

• Work in Agile (Scrum/Kanban) teams with DevOps and CI/CD pipelines (Jenkins, GitHub Actions, AWS CodePipeline).
• Provide technical guidance on best practices for integrating the Edge Server with Collibra.
• Collaborate with CDO, Data Governance, and Engineering teams to improve data quality, ingestion efficiency, and metadata management.

Automation AI Integration

• Leverage AI/ML capabilities within Collibra for data quality monitoring and anomaly detection.
• Automate metadata ingestion, data lineage, and governance processes to improve efficiency.

Metadata, Software Engineering, Java, Scalable System Development, Application Programming Interface (API), Software Development, Application Integration, Automation, Web Interface, Ecosystems, * Bachelor’s Degree in Computer Science, Engineering, or a related field.

• 10+ years of relevant experience.
• Hands-on expertise integrating Collibra (or similar, e.g., Informatica) with modern data platforms (e.g., Snowflake, Databricks, AWS).
• Experience with Java SDK, workflows (BPMN), integrations, and UI web development (e.g., React, Angular).
• Strong background in RESTful API and microservice development.
• Experience building ETL/ELT pipelines and working with tools such as Kafka, NiFi, or AWS Glue.
• Familiarity with event-driven architectures and message queues (Kafka, RabbitMQ).
• Solid understanding of metadata management, data governance, and data lineage.
• Experience implementing authentication/authorization (OAuth, SAML, LDAP) and secure application development.
• Hands-on experience with Agile development and CI/CD pipelines (Jenkins, GitHub Actions, AWS CodePipeline).

Preferred:

• Hands-on experience with Collibra.
• Knowledge of data privacy regulations (GDPR, CCPA, FedRAMP).

Clearance:

• U.S. Citizen; Active DHS Clearance, DoD Top Secret Clearance, or Q-level Clearance.