Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+21 more
Job description
We are seeking an experienced Senior Data Engineer to lead data engineering workstreams supporting Generative AI (GenAI) and Agentic AI solutions for enterprise clients. This role will focus on designing and building scalable data architectures, pipelines, and platforms that power machine learning, GenAI, and agentic systems., o Design, develop, and implement scalable data architectures and pipelines to support machine learning, Generative AI, and agentic systems. o Build and deliver end-to-end Retrieval-Augmented Generation (RAG) solutions, including embeddings, vector databases, context construction, and output handling. o Develop and implement MLOps and LLMOps capabilities, including CI/CD pipelines for data, model observability, automated retraining, and agent evaluation. o Implement data security and governance practices, including PII/PHI protection, authentication, and Role-Based Access Control (RBAC). o Lead feature engineering workstreams and ensure the delivery of scalable and reliable data solutions. o Provide technical guidance and mentorship to junior engineers. o Collaborate with cross-functional teams and client stakeholders to deliver AI-driven data engineering solutions.
Requirements
The ideal candidate will have strong hands-on experience with Python, SQL, Databricks or Snowflake, and production-grade AI data solutions, including Retrieval-Augmented Generation (RAG), embeddings, and vector search. Experience working in government, defense, aerospace, utilities, or oil and gas environments is highly desirable., o 6+ years of experience in Data Engineering, including ownership and leadership of technical workstreams. o Expert-level proficiency in Python and SQL. o Experience with Scala or Java based on client technology requirements. o Strong hands-on experience with Databricks or Snowflake (mandatory). o Experience with Apache Spark and data orchestration tools such as Airflow, Dagster, or Kedro. o Experience with Lang Chain for building AI and data pipelines. o Production-level experience with Generative AI or Agentic AI data solutions, including: o Retrieval-Augmented Generation (RAG) o Embeddings o Vector databases and vector search Hands-on experience with Terraform and at least one major cloud platform: AWS, Azure. Strong experience designing and developing APIs., o Experience with agent evaluation and observability tools such as LangSmith, Opik, or Langfuse. o Familiarity with AI coding agents and development tools such as Cursor, Claude Code, or Codex. o Previous experience delivering projects within government, defense, aerospace, utilities, or oil and gas industries. o Strong technical leadership, problem-solving, and client-facing communication skill. The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, paid time off, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, and paid holidays annually - as applicable.
About the company
Collabera is a global leader in talent solutions, helping businesses grow and professionals build meaningful careers. We bring to life the dignity of work. In our pursuit of greatness, we are dedicated to developing individuals, building strong teams, and fostering a culture of unity and care - creating lasting impact for clients and communities worldwide for nearly 30 years.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦