Data Engineer

Collabera
Atlanta, GA, United States
1 day ago
Apply on www.collabera.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
$145,600 - $166,400
Working hours
Regular working hours

Tech stack

Java (Programming Language) Artificial Intelligence Airflow Amazon Web Services Microsoft Azure Data Architecture Information Engineering Data Security Data Systems Cursor Programming Tools Python (Programming Language)
+21 more
Machine Learning Language Modeling Role-Based Access Control Search Technologies SQL Databases Feature Engineering Claude Code Snowflake Grafana Apache Spark Generative AI AI Coding Agents Langfuse β€” LLM Observability and Analytics Platform Agentic-AI LangSmith Data Management Machine Learning Operations Api Design Terraform Data Pipelines Databricks

Job description

We are seeking an experienced Senior Data Engineer to lead data engineering workstreams supporting Generative AI (GenAI) and Agentic AI solutions for enterprise clients. This role will focus on designing and building scalable data architectures, pipelines, and platforms that power machine learning, GenAI, and agentic systems., o Design, develop, and implement scalable data architectures and pipelines to support machine learning, Generative AI, and agentic systems. o Build and deliver end-to-end Retrieval-Augmented Generation (RAG) solutions, including embeddings, vector databases, context construction, and output handling. o Develop and implement MLOps and LLMOps capabilities, including CI/CD pipelines for data, model observability, automated retraining, and agent evaluation. o Implement data security and governance practices, including PII/PHI protection, authentication, and Role-Based Access Control (RBAC). o Lead feature engineering workstreams and ensure the delivery of scalable and reliable data solutions. o Provide technical guidance and mentorship to junior engineers. o Collaborate with cross-functional teams and client stakeholders to deliver AI-driven data engineering solutions.

Requirements

The ideal candidate will have strong hands-on experience with Python, SQL, Databricks or Snowflake, and production-grade AI data solutions, including Retrieval-Augmented Generation (RAG), embeddings, and vector search. Experience working in government, defense, aerospace, utilities, or oil and gas environments is highly desirable., o 6+ years of experience in Data Engineering, including ownership and leadership of technical workstreams. o Expert-level proficiency in Python and SQL. o Experience with Scala or Java based on client technology requirements. o Strong hands-on experience with Databricks or Snowflake (mandatory). o Experience with Apache Spark and data orchestration tools such as Airflow, Dagster, or Kedro. o Experience with Lang Chain for building AI and data pipelines. o Production-level experience with Generative AI or Agentic AI data solutions, including: o Retrieval-Augmented Generation (RAG) o Embeddings o Vector databases and vector search Hands-on experience with Terraform and at least one major cloud platform: AWS, Azure. Strong experience designing and developing APIs., o Experience with agent evaluation and observability tools such as LangSmith, Opik, or Langfuse. o Familiarity with AI coding agents and development tools such as Cursor, Claude Code, or Codex. o Previous experience delivering projects within government, defense, aerospace, utilities, or oil and gas industries. o Strong technical leadership, problem-solving, and client-facing communication skill. The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, paid time off, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, and paid holidays annually - as applicable.

About the company

Collabera is a global leader in talent solutions, helping businesses grow and professionals build meaningful careers. We bring to life the dignity of work. In our pursuit of greatness, we are dedicated to developing individuals, building strong teams, and fostering a culture of unity and care - creating lasting impact for clients and communities worldwide for nearly 30 years.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collabera.com
Prepare application

Good distractions

Loading talks and stories from around this role…